-- Logs begin at Fri 2022-08-19 16:53:58 UTC, end at Fri 2022-08-19 18:19:53 UTC. -- Aug 19 17:47:27.351177 dv-osbrick-853778-2-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 19 17:47:27.360676 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 19 17:47:27 2022] *** Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: nodename: dv-osbrick-853778-2-ceph Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: machine: x86_64 Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: clock source: unix Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: pcre jit disabled Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: detected number of CPU cores: 4 Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: current working directory: / Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: detected binary path: /usr/bin/uwsgi-core Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: your processes number limit is 47680 Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: your memory page size is 4096 bytes Aug 19 17:47:27.362712 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: detected max file descriptor number: 2048 Aug 19 17:47:27.363578 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: lock engine: pthread robust mutexes Aug 19 17:47:27.363578 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: thunder lock: enabled Aug 19 17:47:27.363578 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 19 17:47:27.363578 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 19 17:47:27.407163 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: Python main interpreter initialized at 0x55f4038fb9c0 Aug 19 17:47:27.407163 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: python threads support enabled Aug 19 17:47:27.407163 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: your server socket listen backlog is limited to 100 connections Aug 19 17:47:27.407163 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: your mercy for graceful operations on workers is 90 seconds Aug 19 17:47:27.407516 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: mapped 403077 bytes (393 KB) for 2 cores Aug 19 17:47:27.407591 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: *** Operational MODE: preforking *** Aug 19 17:47:27.407819 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: *** uWSGI is running in multiple interpreter mode *** Aug 19 17:47:27.407819 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: spawned uWSGI master process (pid: 88340) Aug 19 17:47:27.408016 dv-osbrick-853778-2-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 19 17:47:27.408837 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: spawned uWSGI worker 1 (pid: 88351, cores: 1) Aug 19 17:47:27.408926 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: spawned uWSGI worker 2 (pid: 88352, cores: 1) Aug 19 17:47:27.411863 dv-osbrick-853778-2-ceph devstack@keystone.service[88340]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 19 17:47:32.122864 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 17:47:32.122864 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: from cryptography.utils import int_from_bytes Aug 19 17:47:32.123674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 17:47:32.123674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: from cryptography.utils import int_from_bytes Aug 19 17:47:32.123674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 17:47:32.123674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: from cryptography.utils import int_from_bytes Aug 19 17:47:32.124183 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 19 17:47:32.124183 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: from cryptography.utils import int_from_bytes Aug 19 17:47:32.178967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 17:47:32.179163 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 17:47:32.179245 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 19 17:47:32.179337 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] command line args: [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 17:47:32.179411 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 19 17:47:32.179586 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] command line args: [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 19 17:47:32.179679 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 17:47:32.179757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ================================================================================ {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 17:47:32.179864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 19 17:47:32.179995 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] admin_token = **** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.180081 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ================================================================================ {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 19 17:47:32.180246 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] config_dir = [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.180333 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] admin_token = **** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.180436 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.180515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] config_dir = [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.180619 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] config_source = [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.180699 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.180800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] debug = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.180887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] config_source = [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181007 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181257 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] debug = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181257 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181409 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181569 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181808 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.181933 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182043 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182146 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182271 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] list_limit = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182377 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] list_limit = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182483 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] log_config_append = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] log_config_append = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182788 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] log_dir = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.182997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] log_dir = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.183098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] log_file = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.183199 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] log_file = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.183330 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.183435 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.183998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184068 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184212 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184291 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184551 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.184989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185072 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185276 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185398 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185513 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185592 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185740 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185827 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.185973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.186056 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.186206 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.186286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.186452 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.186544 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.186694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.186829 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.186965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.187044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.187457 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.187595 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.187682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] publish_errors = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.187758 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] publish_errors = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.187880 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.187953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188076 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188149 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188339 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188547 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188767 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.188923 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] standard_threads = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.189000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] standard_threads = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.189154 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.189238 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.189394 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.189493 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.189597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.189665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.189992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] use_journal = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190078 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] use_journal = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190146 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] use_json = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190204 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] use_json = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] use_stderr = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] use_stderr = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] use_syslog = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190456 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] use_syslog = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190521 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190580 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 19 17:47:32.190762 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.190861 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191012 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191244 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191328 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191482 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191566 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191730 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191807 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.191964 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.192046 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.192211 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.192294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.192445 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.192522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.192690 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.192766 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.192933 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.193008 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.193179 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.193257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.193410 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.193529 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.193675 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.193783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.193912 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.194022 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.194159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.194269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.194405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.194517 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.194642 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.194755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.194896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.195009 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.195149 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.195269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.195396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.195514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.195631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.195749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.195885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196143 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196510 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196644 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196908 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.196982 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.197094 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.197206 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.197324 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.197457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.197581 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.197708 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.197829 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.197928 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.198076 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.198160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.198306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.198386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.198535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.198613 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.198782 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.198915 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.199137 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.199247 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.199887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.199962 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.200134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.200224 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.200401 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.200480 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.200645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.200730 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.200887 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.200973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.201122 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.201200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.201357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.201458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.201614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.201707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.201846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.201932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.202083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.202161 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.202330 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.202415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.202560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.202637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.202794 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.202876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203025 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203500 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203775 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203850 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.203970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204050 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204202 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204279 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204438 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204516 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204673 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204759 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.204985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.205137 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.205216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.205367 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.205475 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.205640 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.205717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.205875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.205952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.206110 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.206197 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.206340 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.206431 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.206596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.206676 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.206831 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.206917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.207061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.207141 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.207298 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.207375 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.207532 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.207618 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.207799 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.207885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208036 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208116 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208372 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208529 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208606 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208767 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208850 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.208999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.209175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.209291 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.209389 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.209544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.209766 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.209897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.209979 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210234 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210392 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210471 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210637 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210724 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210874 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.210952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.211134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.211234 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.211369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.211478 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.211631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.211745 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.211871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.211991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.212111 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.212237 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.212346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.212479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.212586 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.212724 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.212811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.212967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.213045 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.213206 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.213284 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.213470 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.213567 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.213707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.213805 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.213925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.214002 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.214164 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.214359 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.214443 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.214597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.214676 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.214876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.214982 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.215117 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.215272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.215370 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.215530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.215771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.215859 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.216031 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.216110 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.216293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.216372 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.216536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.216623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] auth.external = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.216771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.216850 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] auth.external = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.217073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.217164 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.217305 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.217395 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.217553 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] auth.password = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.217629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.217780 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] auth.token = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.217859 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] auth.password = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218098 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] auth.token = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218338 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218584 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218736 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218868 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.218986 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.219104 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.219232 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.219355 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.219463 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.219606 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.219693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] credential.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.219841 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.219928 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.220080 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] credential.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.220159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.220330 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.220416 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.220579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.220659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.220830 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.220910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.221066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.221153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.221309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.221388 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.221569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.221652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.221813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.221911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.222068 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.222148 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.222305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.222382 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.222558 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.222646 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.222836 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.222915 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.223078 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.223156 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.223335 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.223491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.223568 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] federation.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.223646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.223797 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.223877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.224114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.224216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] federation.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.224291 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.224361 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.224534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.224613 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.224779 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.224866 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.225010 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.225092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.225260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.225338 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.225518 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.225614 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.225772 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.225850 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226004 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226249 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226335 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226483 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226561 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226729 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226808 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.226965 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227053 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227199 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227433 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227513 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.227978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.228137 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.228255 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.228379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.228466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.228627 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.228705 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.228860 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.228938 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.229091 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.229172 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.229320 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.229399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.229574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.229652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.229805 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.229892 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.230046 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.230164 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.230292 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.230378 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.230623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.230703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.230897 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.230975 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.231134 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.231241 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.231372 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.231517 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.231604 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.231756 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.231836 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.231994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.232081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.232226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.232306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.232463 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.232541 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.232692 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.232779 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.232927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233006 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233168 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233246 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233407 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233549 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233756 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.233982 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.234150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.234236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.234394 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.234473 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.234614 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.234690 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.234847 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.234937 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.235077 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.235183 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.235462 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.235559 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.235633 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.235704 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.235801 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.235880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236036 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236358 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236508 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236586 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236744 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.236974 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.237060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.237204 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.237284 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.237476 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.237558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.237713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.237805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.237940 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238020 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238643 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238723 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238873 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.238950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.239106 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.239245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.239422 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.239504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.239577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.239649 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.239818 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.239909 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.240065 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.240196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.240301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.240381 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.240531 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.240612 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.240772 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.240852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.241005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.241084 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.241239 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.241319 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.241493 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.241575 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.241725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.241804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251133 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251254 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251481 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251547 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251706 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251778 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.251994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252218 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252416 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252562 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252666 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252785 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.252960 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253037 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253198 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253525 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253756 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253827 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.253968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254039 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254183 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254260 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254331 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254482 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254559 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254639 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254711 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254782 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254923 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] resource.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.254994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255144 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255215 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255276 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255334 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] resource.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255487 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255560 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255702 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255773 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255843 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255916 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.255988 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256059 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256130 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256271 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256354 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] role.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256427 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] role.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256639 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256789 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] role.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.256932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] role.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257074 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257144 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257295 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257366 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257521 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257592 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257736 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257796 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257854 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.257953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258099 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258219 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258277 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258423 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258496 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258496 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258613 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258683 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258747 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.258966 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259036 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259036 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259153 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259372 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259728 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259798 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.259937 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260007 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260085 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260225 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260295 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260364 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260434 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260653 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260797 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260869 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.260946 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261157 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261228 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] token.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261492 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261567 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261645 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.261739 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262373 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262432 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] token.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262490 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262548 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262606 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262672 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262732 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262791 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.262965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263030 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263090 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263148 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263206 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263264 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263321 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263460 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263601 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263819 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263891 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.263952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.connection = **** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264470 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264869 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.264950 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.265106 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.265187 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.connection = **** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.265354 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.265471 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.265616 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.265699 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.265863 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.265945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.266100 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.266182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.266350 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.266433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.266587 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.266667 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.266831 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.266910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.267059 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.267139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.267300 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.267380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.267535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.267621 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.267703 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 17:47:32.267775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.268004 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.268254 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.268491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.268736 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.268967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.269209 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.269464 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 19 17:47:32.269638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88352) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 19 17:47:32.299394 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.299556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.299661 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.299739 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.299813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.299918 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.308391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.309012 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.337674 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.337906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.338872 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.339113 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.399908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.400054 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.453126 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.453353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.454335 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.454567 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.530860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.531097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.531313 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.531402 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.531534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.531621 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.531754 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.531838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.531970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.532062 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.532188 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.532403 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.567363 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.567594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.567729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.567840 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.567951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.568034 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.568185 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.568278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.568415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.568498 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.568642 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.568723 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.568886 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.569168 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.579886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.580075 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.592644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.592877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.593101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.593189 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.593327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.593411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.593573 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.593669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.593790 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.593872 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.594006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88352) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.594079 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.594284 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.594504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 19 17:47:32.611608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.611733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.611810 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 17:47:32.611885 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 17:47:32.612148 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.612232 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.612350 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 17:47:32.612433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 19 17:47:32.612622 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.612703 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.612887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.613035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.613138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.613218 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.613392 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.613513 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.623696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.623972 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.624253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.624367 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.624537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.631537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.631537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.631537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.631777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.632305 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.634407 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.634689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.634975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.635235 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.635319 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.635524 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.635609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.635784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.635865 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.636057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.636142 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.636331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.636414 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.636623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.636703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.636904 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.637071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.637181 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.637350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.637588 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.637955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.638233 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.661657 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.661761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.663337 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.663428 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.663626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.663721 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.668876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.668973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.669167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.669251 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.669478 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.669675 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.676076 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.676370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.677602 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.677896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.680386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.680679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.680964 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.681378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.681681 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.681865 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.681975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.682162 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.682244 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.682453 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.682543 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.682749 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.683034 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.683546 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.684329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.684610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.698854 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.699175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.700722 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.701004 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.703043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.710488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.710578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.710578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.710708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.710708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.711226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.712847 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.714365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.716204 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.717663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.717977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.718266 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.718663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.718986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.719241 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.719333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.719622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.719927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.720229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.720525 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.720912 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.735712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.736003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.736274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.736548 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.737696 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.737989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.738265 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.738532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.743294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.745052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.745349 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.745504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.747683 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.747963 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.748582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.748871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.749158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.749472 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.749760 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.750635 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.750924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.751212 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.751510 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.751793 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.760902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.761189 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.761500 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.761825 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.762219 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.762495 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.762668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.763930 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.764252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.764538 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.764909 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.765346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.765691 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.765985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.778074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.780959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.782072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.784071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.785045 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.785538 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.787278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.787567 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.787852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.788335 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.789791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.791269 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.791559 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.791872 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.794910 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.796403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.799287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.799478 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.799565 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.799857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.800162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.800965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.804064 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.804367 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.804659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.804952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.809786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.810083 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.813503 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.814353 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.814652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.814938 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.817216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88352) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.817688 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.818014 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.818311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.818593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.818873 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.819162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.819438 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.819713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.819996 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.820278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.820540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.820821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.821085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88352) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.821878 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 19 17:47:32.823208 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.823511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.823808 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.824138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.824626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.824972 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.825262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.825572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.825865 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.826153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.826433 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.826716 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.826984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 19 17:47:32.854552 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f4038fb9c0 pid: 88352 (default app) Aug 19 17:47:32.858630 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9897446-b7a1-461e-8568-cb7a66909203 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:32.858924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9897446-b7a1-461e-8568-cb7a66909203 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:32.859200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9897446-b7a1-461e-8568-cb7a66909203 None None] PATH_INFO: `/v3` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:32.862111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f4038fb9c0 pid: 88351 (default app) Aug 19 17:47:32.863306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Fri Aug 19 17:47:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:40.838831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb585-6892-4327-a694-26614223b3e4 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:40.839393 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb585-6892-4327-a694-26614223b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:40.839393 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662eb585-6892-4327-a694-26614223b3e4 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:40.844212 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:40.849491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:40.849902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:40.850060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:40.927547 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: INFO dbcounter [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] Registered counter for database keystone Aug 19 17:47:40.946914 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG oslo_db.sqlalchemy.engines [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88352) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 17:47:40.953955 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writer thread running {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 17:47:41.135805 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG passlib.handlers.bcrypt [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88352) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 17:47:41.136857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG passlib.handlers.bcrypt [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88352) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 17:47:41.190929 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:41.192559 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:41.321097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 19 17:47:41.870533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eb585-6892-4327-a694-26614223b3e4 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:41.945999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: INFO dbcounter [None req-662eb585-6892-4327-a694-26614223b3e4 None None] Registered counter for database keystone Aug 19 17:47:41.967917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG oslo_db.sqlalchemy.engines [None req-662eb585-6892-4327-a694-26614223b3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 19 17:47:41.974010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writer thread running {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 19 17:47:42.091795 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662eb585-6892-4327-a694-26614223b3e4 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:42.096035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220a34-b454-4437-a7ae-518d66851dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:42.096659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220a34-b454-4437-a7ae-518d66851dea admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:42.096939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220a34-b454-4437-a7ae-518d66851dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:42.097207 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220a34-b454-4437-a7ae-518d66851dea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:42.105820 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7220a34-b454-4437-a7ae-518d66851dea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:42.160469 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d7220a34-b454-4437-a7ae-518d66851dea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 17:47:42.160750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7220a34-b454-4437-a7ae-518d66851dea admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:42.171260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Aug 19 17:47:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 17:47:42.177149 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:42.193917 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bac2dd-faf9-4eed-a3cd-75ad9ccf2674 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:42.198217 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cb7da-4e90-4242-83e6-049454535515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:42.200114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb7da-4e90-4242-83e6-049454535515 admin admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:42.200396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb7da-4e90-4242-83e6-049454535515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:42.200668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb7da-4e90-4242-83e6-049454535515 admin admin] PATH_INFO: `/v3/projects/36dbac3e54734453afe30db9d0d35548` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:42.202136 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cb7da-4e90-4242-83e6-049454535515 admin admin] RBAC: Authorizing `identity:get_project(project_id=36dbac3e54734453afe30db9d0d35548)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:42.252631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a09cb7da-4e90-4242-83e6-049454535515 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 19 17:47:42.252972 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cb7da-4e90-4242-83e6-049454535515 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:42.257495 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Aug 19 17:47:42 2022] GET /identity/v3/projects/36dbac3e54734453afe30db9d0d35548 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:44.397959 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877e15-0e0c-4dab-bb4d-38118105fb4d None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:44.398508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877e15-0e0c-4dab-bb4d-38118105fb4d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:44.398508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877e15-0e0c-4dab-bb4d-38118105fb4d None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:44.403437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:44.408959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ae62-23ce-47ef-9c10-e5dd94bee3dc None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:44.409398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ae62-23ce-47ef-9c10-e5dd94bee3dc None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:44.409519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ae62-23ce-47ef-9c10-e5dd94bee3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:44.429203 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-5634ae62-23ce-47ef-9c10-e5dd94bee3dc None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:44.430728 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-5634ae62-23ce-47ef-9c10-e5dd94bee3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:44.439514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 19 17:47:44.764744 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877e15-0e0c-4dab-bb4d-38118105fb4d None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:44.776780 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd877e15-0e0c-4dab-bb4d-38118105fb4d None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:44.781030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e31465-80b0-4482-aef9-82c01381f77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:44.781654 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e31465-80b0-4482-aef9-82c01381f77a admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:44.781937 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e31465-80b0-4482-aef9-82c01381f77a admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:44.782210 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e31465-80b0-4482-aef9-82c01381f77a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:44.790184 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e31465-80b0-4482-aef9-82c01381f77a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:44.791980 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e31465-80b0-4482-aef9-82c01381f77a admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:44.801396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Aug 19 17:47:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 19 17:47:44.806689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634ae62-23ce-47ef-9c10-e5dd94bee3dc None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:44.816321 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634ae62-23ce-47ef-9c10-e5dd94bee3dc None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:44.820569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301d68a-6975-4c63-bb95-4c86133a9db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:44.821187 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d68a-6975-4c63-bb95-4c86133a9db1 admin admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:44.821500 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d68a-6975-4c63-bb95-4c86133a9db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:44.821771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301d68a-6975-4c63-bb95-4c86133a9db1 admin admin] PATH_INFO: `/v3/users/bd3642203b2a4a53b69987de767c8bbd` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:44.823044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301d68a-6975-4c63-bb95-4c86133a9db1 admin admin] RBAC: Authorizing `identity:get_user(user_id=bd3642203b2a4a53b69987de767c8bbd)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:44.824912 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301d68a-6975-4c63-bb95-4c86133a9db1 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:44.826442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Aug 19 17:47:44 2022] GET /identity/v3/users/bd3642203b2a4a53b69987de767c8bbd => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:47.092292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbaeac-3c11-4a74-84aa-b4cfa594d5f7 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:47.092839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbaeac-3c11-4a74-84aa-b4cfa594d5f7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:47.092839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbaeac-3c11-4a74-84aa-b4cfa594d5f7 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:47.094187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:47.099423 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d0af-48ed-49bf-9ced-8a4764da3e77 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:47.099871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d0af-48ed-49bf-9ced-8a4764da3e77 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:47.100007 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d0af-48ed-49bf-9ced-8a4764da3e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:47.105309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66175ebb-5ad0-49f0-b6f9-718c775d6f14 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:47.105623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66175ebb-5ad0-49f0-b6f9-718c775d6f14 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:47.105946 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66175ebb-5ad0-49f0-b6f9-718c775d6f14 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:47.107230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:47:47.112347 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:47.112631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:47.112910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:47.118844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-8ae5d0af-48ed-49bf-9ced-8a4764da3e77 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:47.120021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-8ae5d0af-48ed-49bf-9ced-8a4764da3e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:47.154554 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG passlib.handlers.bcrypt [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 19 17:47:47.154970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG passlib.handlers.bcrypt [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 19 17:47:47.201446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:47.203073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:47.312546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:47:47.322972 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:47:47.639771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d0af-48ed-49bf-9ced-8a4764da3e77 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:47.646929 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:47.667175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:47.747569 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:47.747756 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d0af-48ed-49bf-9ced-8a4764da3e77 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:47.750503 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41f175-7405-4cbb-a4fc-4b224dfa78eb None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:47.781858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67a593-5936-4998-811c-e4bf7687d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:47.782493 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67a593-5936-4998-811c-e4bf7687d376 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:47.782769 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67a593-5936-4998-811c-e4bf7687d376 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:47.783039 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67a593-5936-4998-811c-e4bf7687d376 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:47.788668 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1e777-8a5b-4db9-bbca-6f2d28461025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:47.789552 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1e777-8a5b-4db9-bbca-6f2d28461025 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:47.789839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1e777-8a5b-4db9-bbca-6f2d28461025 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:47.790116 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1e777-8a5b-4db9-bbca-6f2d28461025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:47.794975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67a593-5936-4998-811c-e4bf7687d376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-5b67a593-5936-4998-811c-e4bf7687d376 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:47:47.803232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:47:47.804344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:47:47.805167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:47:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:47:47.810129 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67a593-5936-4998-811c-e4bf7687d376 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:47.860562 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1e777-8a5b-4db9-bbca-6f2d28461025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:47.862138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1e777-8a5b-4db9-bbca-6f2d28461025 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:47.893996 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:47.911788 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67a593-5936-4998-811c-e4bf7687d376 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:47.945849 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:47.946466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:47.946749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:47.947025 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:47.947703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:47:47.948008 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:47.950225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:47.958925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:47.968437 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:47:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:47.968596 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 17:47:47.969270 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:47.973940 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1e777-8a5b-4db9-bbca-6f2d28461025 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:48.071644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49d613-1dc9-4214-9e57-e9b8e7bf9994 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:48.076050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1e777-8a5b-4db9-bbca-6f2d28461025 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:48.105562 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f73d7-6184-45fd-b099-2147c2fa3d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:48.106198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f73d7-6184-45fd-b099-2147c2fa3d0c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:48.106479 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f73d7-6184-45fd-b099-2147c2fa3d0c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:48.106759 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f73d7-6184-45fd-b099-2147c2fa3d0c None admin] PATH_INFO: `/v3/users/bd3642203b2a4a53b69987de767c8bbd` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:48.107906 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f73d7-6184-45fd-b099-2147c2fa3d0c None admin] RBAC: Authorizing `identity:get_user(user_id=bd3642203b2a4a53b69987de767c8bbd)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:48.109601 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f73d7-6184-45fd-b099-2147c2fa3d0c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:48.109737 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:48.110357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:48.110634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:48.110903 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:48.111412 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:47:47 2022] GET /identity/v3/users/bd3642203b2a4a53b69987de767c8bbd => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:48.116624 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f73d7-6184-45fd-b099-2147c2fa3d0c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:48.132211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:48.134444 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:48.136647 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:47:48.156771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:47:48.157748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:47:48.158734 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:47:48.158734 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:47:48.158734 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:47:48.158734 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:47:48.163832 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:48.227851 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f73d7-6184-45fd-b099-2147c2fa3d0c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:48.269821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddc8b7-705e-4ebf-8d49-b91c1178cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:48.297490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddc8b7-705e-4ebf-8d49-b91c1178cf54 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:48.297490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddc8b7-705e-4ebf-8d49-b91c1178cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:48.297490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddc8b7-705e-4ebf-8d49-b91c1178cf54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:48.297490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddc8b7-705e-4ebf-8d49-b91c1178cf54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:48.297490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddc8b7-705e-4ebf-8d49-b91c1178cf54 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:48.297490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:47:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:48.297989 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddc8b7-705e-4ebf-8d49-b91c1178cf54 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:48.331104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:48.367678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:48.379909 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e9fb-b18d-4d50-98bf-d31a0bc0901a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:48.387878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddc8b7-705e-4ebf-8d49-b91c1178cf54 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:48.414645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2900c-523d-4801-a168-51c2c6530034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:48.415252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2900c-523d-4801-a168-51c2c6530034 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:48.415529 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2900c-523d-4801-a168-51c2c6530034 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:48.415799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2900c-523d-4801-a168-51c2c6530034 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:48.416466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2900c-523d-4801-a168-51c2c6530034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:47:48.416769 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2900c-523d-4801-a168-51c2c6530034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:48.418617 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2900c-523d-4801-a168-51c2c6530034 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:48.421943 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77244b16-0aad-484a-83d1-9ead91ff22ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:48.423946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244b16-0aad-484a-83d1-9ead91ff22ee None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:48.423946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244b16-0aad-484a-83d1-9ead91ff22ee None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:48.423946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77244b16-0aad-484a-83d1-9ead91ff22ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:48.424313 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244b16-0aad-484a-83d1-9ead91ff22ee None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.domain.id=default, user.id=bd3642203b2a4a53b69987de767c8bbd) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:47:48.424568 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244b16-0aad-484a-83d1-9ead91ff22ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:48.426008 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77244b16-0aad-484a-83d1-9ead91ff22ee None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:48.432518 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Aug 19 17:47:48 2022] GET /identity/v3/role_assignments?user.id=bd3642203b2a4a53b69987de767c8bbd&scope.domain.id=default&role.id=757702b4209942a3b2ec7bf21d995169 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:48.436337 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:50.770010 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239536b-7817-475d-a42d-9a837c208514 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:50.770505 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239536b-7817-475d-a42d-9a837c208514 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:50.770505 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239536b-7817-475d-a42d-9a837c208514 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:50.771806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:50.778577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39048864-4d22-49b9-9cd4-c8d70bada194 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:50.779078 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39048864-4d22-49b9-9cd4-c8d70bada194 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:50.779295 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39048864-4d22-49b9-9cd4-c8d70bada194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:50.806646 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-39048864-4d22-49b9-9cd4-c8d70bada194 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:50.807942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-39048864-4d22-49b9-9cd4-c8d70bada194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:50.897780 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:47:50.955377 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab36bce-7509-493b-9a3d-d7abcd2a3e53 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:50.955987 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab36bce-7509-493b-9a3d-d7abcd2a3e53 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:50.956509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab36bce-7509-493b-9a3d-d7abcd2a3e53 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:50.958324 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:50.963910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b06e7c-c4f6-4e1f-8a5a-b2d6b9bedfc4 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:50.964201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b06e7c-c4f6-4e1f-8a5a-b2d6b9bedfc4 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:50.964699 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b06e7c-c4f6-4e1f-8a5a-b2d6b9bedfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:50.990476 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-c7b06e7c-c4f6-4e1f-8a5a-b2d6b9bedfc4 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:50.991697 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-c7b06e7c-c4f6-4e1f-8a5a-b2d6b9bedfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:51.035385 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:51.075273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 12/25] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:47:51.410370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab36bce-7509-493b-9a3d-d7abcd2a3e53 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:51.543583 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f624c1e-8916-465d-a620-3dbd24b67213 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:51.544017 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab36bce-7509-493b-9a3d-d7abcd2a3e53 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:51.544466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f624c1e-8916-465d-a620-3dbd24b67213 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:51.544945 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f624c1e-8916-465d-a620-3dbd24b67213 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:51.546524 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 13/26] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:51.554716 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437106f-aadc-4f15-8eef-44e7ad9487f9 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:51.555360 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437106f-aadc-4f15-8eef-44e7ad9487f9 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:51.555845 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437106f-aadc-4f15-8eef-44e7ad9487f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:51.582924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689e29d-df6e-4559-aacc-005c9a00a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:51.583572 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689e29d-df6e-4559-aacc-005c9a00a554 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:51.583855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689e29d-df6e-4559-aacc-005c9a00a554 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:51.584129 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689e29d-df6e-4559-aacc-005c9a00a554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:51.595934 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689e29d-df6e-4559-aacc-005c9a00a554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-6689e29d-df6e-4559-aacc-005c9a00a554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:47:51.601342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:47:51.602237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:47:51.602994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 14/27] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:47:51.610487 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-7437106f-aadc-4f15-8eef-44e7ad9487f9 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:51.610644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689e29d-df6e-4559-aacc-005c9a00a554 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:51.612180 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-7437106f-aadc-4f15-8eef-44e7ad9487f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:51.625183 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:51.723656 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689e29d-df6e-4559-aacc-005c9a00a554 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:51.756183 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 14/28] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:47:51.757187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437106f-aadc-4f15-8eef-44e7ad9487f9 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:51.780946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:51.782280 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:51.782793 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:51.783328 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:51.784203 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:47:51.784720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:51.786619 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:51.796685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 15/29] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:47:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:51.803274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:51.927783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:51.949824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437106f-aadc-4f15-8eef-44e7ad9487f9 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:51.952224 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:51.969655 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db61c14-c5f5-48ef-8a81-ccbbda8e822e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:51.994387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb09591-d1c3-4ec3-9a5d-8ab2b1cb6946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:51.995924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09591-d1c3-4ec3-9a5d-8ab2b1cb6946 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:51.996487 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09591-d1c3-4ec3-9a5d-8ab2b1cb6946 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:51.996919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09591-d1c3-4ec3-9a5d-8ab2b1cb6946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:52.008901 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb09591-d1c3-4ec3-9a5d-8ab2b1cb6946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:52.011125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb09591-d1c3-4ec3-9a5d-8ab2b1cb6946 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-8eb09591-d1c3-4ec3-9a5d-8ab2b1cb6946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:47:52.029519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:47:52.030411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:47:52.031209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:47:52.031209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:47:52.031209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:47:52.037682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 15/30] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:47:52.039834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62127-0ed3-47bc-8575-a287207694be None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:52.040323 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62127-0ed3-47bc-8575-a287207694be None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:52.040799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df62127-0ed3-47bc-8575-a287207694be None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:52.043157 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 16/31] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:52.048890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df62127-0ed3-47bc-8575-a287207694be None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:52.056106 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92778e75-576c-497c-8191-dec05a9d1446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:52.056808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778e75-576c-497c-8191-dec05a9d1446 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:52.057095 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778e75-576c-497c-8191-dec05a9d1446 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:52.057398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778e75-576c-497c-8191-dec05a9d1446 None admin] PATH_INFO: `/v3/users/bd3642203b2a4a53b69987de767c8bbd` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:52.059182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778e75-576c-497c-8191-dec05a9d1446 None admin] RBAC: Authorizing `identity:get_user(user_id=bd3642203b2a4a53b69987de767c8bbd)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:52.060758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778e75-576c-497c-8191-dec05a9d1446 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:52.062583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 16/32] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:47:51 2022] GET /identity/v3/users/bd3642203b2a4a53b69987de767c8bbd => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:52.063697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e8c1-62ba-4996-9e13-6e5a973df9ec None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:52.064037 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e8c1-62ba-4996-9e13-6e5a973df9ec None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:52.064318 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e8c1-62ba-4996-9e13-6e5a973df9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:52.083545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-9e18e8c1-62ba-4996-9e13-6e5a973df9ec None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:52.086537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-9e18e8c1-62ba-4996-9e13-6e5a973df9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:52.203630 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:47:52.205086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e8c1-62ba-4996-9e13-6e5a973df9ec None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:52.243944 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df62127-0ed3-47bc-8575-a287207694be None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:52.285285 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:52.292670 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:52.308343 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:52.308343 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:52.308343 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:52.308343 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:47:52.308343 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:52.308343 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:52.313717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 17/34] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:52.314675 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:52.328277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e8c1-62ba-4996-9e13-6e5a973df9ec None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:52.336663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:52.394291 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097206-e3f2-4b9d-8b6d-d1cbf5eaa140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:52.396917 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097206-e3f2-4b9d-8b6d-d1cbf5eaa140 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:52.398215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097206-e3f2-4b9d-8b6d-d1cbf5eaa140 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:52.398742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37097206-e3f2-4b9d-8b6d-d1cbf5eaa140 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:52.402564 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37097206-e3f2-4b9d-8b6d-d1cbf5eaa140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:52.407349 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37097206-e3f2-4b9d-8b6d-d1cbf5eaa140 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:52.410811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 18/35] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:47:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:52.412864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097206-e3f2-4b9d-8b6d-d1cbf5eaa140 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:52.517521 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4a77f-4571-4fa6-8f47-e17524709238 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:52.580998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cfc8d-7ab6-4f5f-9fc8-933c2b9f772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:52.581616 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cfc8d-7ab6-4f5f-9fc8-933c2b9f772e None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:52.581910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cfc8d-7ab6-4f5f-9fc8-933c2b9f772e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:52.582193 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cfc8d-7ab6-4f5f-9fc8-933c2b9f772e None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:52.582979 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cfc8d-7ab6-4f5f-9fc8-933c2b9f772e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:52.585229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cfc8d-7ab6-4f5f-9fc8-933c2b9f772e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:52.615655 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37097206-e3f2-4b9d-8b6d-d1cbf5eaa140 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:52.652204 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:52.658604 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80296bbe-0770-402d-9dc7-dec1c2dd4bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:52.659355 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296bbe-0770-402d-9dc7-dec1c2dd4bc4 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:52.659644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296bbe-0770-402d-9dc7-dec1c2dd4bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:52.659922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296bbe-0770-402d-9dc7-dec1c2dd4bc4 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:52.660583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80296bbe-0770-402d-9dc7-dec1c2dd4bc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:52.662499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80296bbe-0770-402d-9dc7-dec1c2dd4bc4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:52.825834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 18/36] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Aug 19 17:47:52 2022] POST /identity/v3/roles => generated 219 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:47:52.827601 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cfc8d-7ab6-4f5f-9fc8-933c2b9f772e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:52.926648 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:52.935215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:47:52 2022] POST /identity/v3/projects => generated 301 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:47:52.935215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80296bbe-0770-402d-9dc7-dec1c2dd4bc4 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:52.972689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cfc8d-7ab6-4f5f-9fc8-933c2b9f772e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:53.022100 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc3ae9-54e3-4f72-8662-47594a2fb1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:53.022797 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3ae9-54e3-4f72-8662-47594a2fb1b6 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.023085 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3ae9-54e3-4f72-8662-47594a2fb1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.023363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc3ae9-54e3-4f72-8662-47594a2fb1b6 None admin] PATH_INFO: `/v3/domains/default/users/bd3642203b2a4a53b69987de767c8bbd/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.026927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc3ae9-54e3-4f72-8662-47594a2fb1b6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bd3642203b2a4a53b69987de767c8bbd, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:53.029062 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc3ae9-54e3-4f72-8662-47594a2fb1b6 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:53.067339 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80296bbe-0770-402d-9dc7-dec1c2dd4bc4 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:53.109198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29b7db-8d40-4d7e-a3c8-5408f63c155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:53.109880 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b7db-8d40-4d7e-a3c8-5408f63c155e None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.110167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b7db-8d40-4d7e-a3c8-5408f63c155e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.110449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b7db-8d40-4d7e-a3c8-5408f63c155e None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.111161 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29b7db-8d40-4d7e-a3c8-5408f63c155e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:53.112834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29b7db-8d40-4d7e-a3c8-5408f63c155e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:53.141764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 19/38] 10.222.0.48 () {58 vars in 1361 bytes} [Fri Aug 19 17:47:52 2022] PUT /identity/v3/domains/default/users/bd3642203b2a4a53b69987de767c8bbd/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:47:53.143247 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834d5e-defb-4ff9-a0ac-6791916d8a70 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.144328 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834d5e-defb-4ff9-a0ac-6791916d8a70 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.144623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4834d5e-defb-4ff9-a0ac-6791916d8a70 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.146046 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 20/39] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:53.147252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636164bd-19e5-4132-8f94-527005bd79d6 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.147528 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636164bd-19e5-4132-8f94-527005bd79d6 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.147810 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636164bd-19e5-4132-8f94-527005bd79d6 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.149342 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 21/40] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:53.155201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41654876-703f-4ed1-b7da-fb56e7c11cff None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.155492 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41654876-703f-4ed1-b7da-fb56e7c11cff None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.155779 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41654876-703f-4ed1-b7da-fb56e7c11cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.176942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-41654876-703f-4ed1-b7da-fb56e7c11cff None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:53.178482 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-41654876-703f-4ed1-b7da-fb56e7c11cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:53.196055 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Aug 19 17:47:52 2022] POST /identity/v3/roles => generated 225 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:47:53.197692 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e7ee-7582-4c53-bc75-1d06520dc13b None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.198147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e7ee-7582-4c53-bc75-1d06520dc13b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.199054 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e7ee-7582-4c53-bc75-1d06520dc13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.221823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-29a8e7ee-7582-4c53-bc75-1d06520dc13b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:53.226127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-29a8e7ee-7582-4c53-bc75-1d06520dc13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:53.267745 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:47:53.279468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:53.317713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:47:53.611579 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41654876-703f-4ed1-b7da-fb56e7c11cff None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:53.654195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8e7ee-7582-4c53-bc75-1d06520dc13b None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:53.678266 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:53.720833 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41654876-703f-4ed1-b7da-fb56e7c11cff None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:53.758369 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df8ecc-15d3-45a5-bd5e-29b04b3d04a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:53.758911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8ecc-15d3-45a5-bd5e-29b04b3d04a1 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.759201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8ecc-15d3-45a5-bd5e-29b04b3d04a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.759492 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df8ecc-15d3-45a5-bd5e-29b04b3d04a1 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.760172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df8ecc-15d3-45a5-bd5e-29b04b3d04a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:53.761669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df8ecc-15d3-45a5-bd5e-29b04b3d04a1 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:53.763706 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8e7ee-7582-4c53-bc75-1d06520dc13b None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:53.799742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105edb-0c4f-4218-83e4-96dbbf0c4f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:53.800380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105edb-0c4f-4218-83e4-96dbbf0c4f06 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.800663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105edb-0c4f-4218-83e4-96dbbf0c4f06 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.800937 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72105edb-0c4f-4218-83e4-96dbbf0c4f06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.802062 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72105edb-0c4f-4218-83e4-96dbbf0c4f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:53.803519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72105edb-0c4f-4218-83e4-96dbbf0c4f06 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:53.805081 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 22/44] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:47:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:53.811059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105edb-0c4f-4218-83e4-96dbbf0c4f06 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:53.855677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:53.862596 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Aug 19 17:47:53 2022] POST /identity/v3/roles => generated 223 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:47:53.923867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72105edb-0c4f-4218-83e4-96dbbf0c4f06 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:53.962562 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186c178-cc26-44a8-8994-f54fba2cbf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:53.963231 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186c178-cc26-44a8-8994-f54fba2cbf74 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:53.964112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186c178-cc26-44a8-8994-f54fba2cbf74 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:53.964472 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186c178-cc26-44a8-8994-f54fba2cbf74 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:53.965224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186c178-cc26-44a8-8994-f54fba2cbf74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:53.966847 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186c178-cc26-44a8-8994-f54fba2cbf74 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:54.062948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:47:53 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:47:55.473607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea98e-7f8f-4d0f-a6a8-f6bb4112d043 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:55.474120 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea98e-7f8f-4d0f-a6a8-f6bb4112d043 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:55.474203 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ea98e-7f8f-4d0f-a6a8-f6bb4112d043 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:55.475541 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 24/47] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:55.481486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82ace-9bcd-45b7-91f5-2ad33f20b7d2 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:55.481878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82ace-9bcd-45b7-91f5-2ad33f20b7d2 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:55.482053 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca82ace-9bcd-45b7-91f5-2ad33f20b7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:55.500871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-8ca82ace-9bcd-45b7-91f5-2ad33f20b7d2 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:55.502089 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-8ca82ace-9bcd-45b7-91f5-2ad33f20b7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:55.569952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 24/48] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:47:55.905359 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea98e-7f8f-4d0f-a6a8-f6bb4112d043 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:56.009572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ea98e-7f8f-4d0f-a6a8-f6bb4112d043 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:56.033790 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:56.044912 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53f54b-d684-45b9-bf18-a73a9995a8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:56.045630 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f54b-d684-45b9-bf18-a73a9995a8e8 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.045934 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f54b-d684-45b9-bf18-a73a9995a8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.046193 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53f54b-d684-45b9-bf18-a73a9995a8e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.058390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53f54b-d684-45b9-bf18-a73a9995a8e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-4c53f54b-d684-45b9-bf18-a73a9995a8e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:47:56.064702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:47:56.065711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:47:56.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 25/49] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:47:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:47:56.072148 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca82ace-9bcd-45b7-91f5-2ad33f20b7d2 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:56.100191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:56.175870 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca82ace-9bcd-45b7-91f5-2ad33f20b7d2 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:56.210307 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:56.210925 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.211217 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.211497 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.212165 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:47:56.212475 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:56.214125 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:56.222428 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 25/50] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:47:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:56.226067 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682339-7db4-4ce0-a91a-fc435f1a628d None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.226358 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682339-7db4-4ce0-a91a-fc435f1a628d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.226626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71682339-7db4-4ce0-a91a-fc435f1a628d None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.227951 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:56.228177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 26/51] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:56.233577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2abd8-ea9a-4dc1-b91d-118a09d9a8bc None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.233938 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2abd8-ea9a-4dc1-b91d-118a09d9a8bc None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.234289 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2abd8-ea9a-4dc1-b91d-118a09d9a8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.252593 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-0df2abd8-ea9a-4dc1-b91d-118a09d9a8bc None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:56.253861 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-0df2abd8-ea9a-4dc1-b91d-118a09d9a8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:56.315170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:56.321093 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 27/52] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:47:56.330348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf46886-ef83-45ef-94af-eb37687e4564 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:56.362757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1122b-9b23-439c-8d3d-eaae46e4cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:56.363389 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1122b-9b23-439c-8d3d-eaae46e4cf38 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.363673 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1122b-9b23-439c-8d3d-eaae46e4cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.363951 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1122b-9b23-439c-8d3d-eaae46e4cf38 None admin] PATH_INFO: `/v3/users/bd3642203b2a4a53b69987de767c8bbd` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.365078 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1122b-9b23-439c-8d3d-eaae46e4cf38 None admin] RBAC: Authorizing `identity:get_user(user_id=bd3642203b2a4a53b69987de767c8bbd)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:56.366574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1122b-9b23-439c-8d3d-eaae46e4cf38 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:56.368142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:47:56 2022] GET /identity/v3/users/bd3642203b2a4a53b69987de767c8bbd => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:56.374153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2abd8-ea9a-4dc1-b91d-118a09d9a8bc None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:56.477343 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2abd8-ea9a-4dc1-b91d-118a09d9a8bc None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:56.494203 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:56.514634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad489f3a-52bc-4162-b1bb-9bb2111c5cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:56.515264 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad489f3a-52bc-4162-b1bb-9bb2111c5cbe None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.515545 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad489f3a-52bc-4162-b1bb-9bb2111c5cbe None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.515819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad489f3a-52bc-4162-b1bb-9bb2111c5cbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.516997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad489f3a-52bc-4162-b1bb-9bb2111c5cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:56.518502 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad489f3a-52bc-4162-b1bb-9bb2111c5cbe None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:56.520102 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:47:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:56.525898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1122b-9b23-439c-8d3d-eaae46e4cf38 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:56.624753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1122b-9b23-439c-8d3d-eaae46e4cf38 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:56.642426 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad489f3a-52bc-4162-b1bb-9bb2111c5cbe None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:56.657276 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:56.657934 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.658217 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.658525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.659250 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.domain.id=default, user.id=bd3642203b2a4a53b69987de767c8bbd) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:47:56.659564 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:56.661013 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:56.667536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Aug 19 17:47:56 2022] GET /identity/v3/role_assignments?user.id=bd3642203b2a4a53b69987de767c8bbd&scope.domain.id=default&role.id=757702b4209942a3b2ec7bf21d995169 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:56.753440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad489f3a-52bc-4162-b1bb-9bb2111c5cbe None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:56.786560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8e4cc-045f-408a-a8e2-25b95c469876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:56.787211 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e4cc-045f-408a-a8e2-25b95c469876 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.787491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e4cc-045f-408a-a8e2-25b95c469876 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.787767 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e4cc-045f-408a-a8e2-25b95c469876 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.788916 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8e4cc-045f-408a-a8e2-25b95c469876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:56.790420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8e4cc-045f-408a-a8e2-25b95c469876 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:56.792698 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:47:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:47:56.798798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:56.820323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:56.905135 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8bec1-c521-4dcd-9cdd-94ad7b7cf260 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:56.939252 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa182c25-9839-499c-935d-33a40de87400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:56.939973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182c25-9839-499c-935d-33a40de87400 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:56.940293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182c25-9839-499c-935d-33a40de87400 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:56.940570 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa182c25-9839-499c-935d-33a40de87400 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:56.941210 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182c25-9839-499c-935d-33a40de87400 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:56.942682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa182c25-9839-499c-935d-33a40de87400 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:57.021535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 28/57] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Aug 19 17:47:56 2022] POST /identity/v3/projects => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:47:59.199383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782766cc-bef0-4c0f-9961-df0982c4863f None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:59.199925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782766cc-bef0-4c0f-9961-df0982c4863f None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:59.199925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782766cc-bef0-4c0f-9961-df0982c4863f None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:59.201267 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:47:59.206527 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220dd9-c3b8-46bd-8adc-2a34897b6598 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:59.206920 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220dd9-c3b8-46bd-8adc-2a34897b6598 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:59.207073 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220dd9-c3b8-46bd-8adc-2a34897b6598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:59.225397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-e1220dd9-c3b8-46bd-8adc-2a34897b6598 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:47:59.226649 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-e1220dd9-c3b8-46bd-8adc-2a34897b6598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:47:59.287803 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:59.292668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:47:59.620260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782766cc-bef0-4c0f-9961-df0982c4863f None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:59.670799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:47:59.720181 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782766cc-bef0-4c0f-9961-df0982c4863f None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:59.752698 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95a5a7-6a19-48e1-8e3d-afc10910b816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:59.753259 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a5a7-6a19-48e1-8e3d-afc10910b816 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:59.753571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a5a7-6a19-48e1-8e3d-afc10910b816 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:59.753848 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a5a7-6a19-48e1-8e3d-afc10910b816 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:59.754955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95a5a7-6a19-48e1-8e3d-afc10910b816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:59.756413 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95a5a7-6a19-48e1-8e3d-afc10910b816 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:47:59.757984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:47:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:47:59.764265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220dd9-c3b8-46bd-8adc-2a34897b6598 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:47:59.861693 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220dd9-c3b8-46bd-8adc-2a34897b6598 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:47:59.895539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654ec08-995d-440d-bb9b-0e053f242773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:47:59.896142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ec08-995d-440d-bb9b-0e053f242773 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:47:59.896422 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ec08-995d-440d-bb9b-0e053f242773 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:47:59.896693 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ec08-995d-440d-bb9b-0e053f242773 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:47:59.897332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654ec08-995d-440d-bb9b-0e053f242773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:47:59.898836 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654ec08-995d-440d-bb9b-0e053f242773 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:00.003003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:47:59 2022] POST /identity/v3/users => generated 275 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:48:03.482309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92f4a-fd8d-483f-b829-ffa49a0d61d3 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:03.488686 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92f4a-fd8d-483f-b829-ffa49a0d61d3 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:03.489205 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92f4a-fd8d-483f-b829-ffa49a0d61d3 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:03.490857 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:03.503122 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e60a5-bc4a-4a39-88d1-4ef943c174c5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:03.503955 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e60a5-bc4a-4a39-88d1-4ef943c174c5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:03.504426 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e60a5-bc4a-4a39-88d1-4ef943c174c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:03.523424 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c34e60a5-bc4a-4a39-88d1-4ef943c174c5 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:03.524933 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c34e60a5-bc4a-4a39-88d1-4ef943c174c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:03.553276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d4c8-94a7-444f-b5fc-a77683b477d7 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:03.553918 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d4c8-94a7-444f-b5fc-a77683b477d7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:03.554367 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7d4c8-94a7-444f-b5fc-a77683b477d7 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:03.556162 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 33/63] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:03.563491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313925e-b5ef-4a36-bfda-db121e366b6d None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:03.564145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313925e-b5ef-4a36-bfda-db121e366b6d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:03.564766 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313925e-b5ef-4a36-bfda-db121e366b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:03.584571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e313925e-b5ef-4a36-bfda-db121e366b6d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:03.585618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:03.587477 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e313925e-b5ef-4a36-bfda-db121e366b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:03.605834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 31/64] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:03.704089 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 34/65] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:03.752739 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547798e0-321e-4497-a40c-95b319c80f8f None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:03.753342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547798e0-321e-4497-a40c-95b319c80f8f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:03.753853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547798e0-321e-4497-a40c-95b319c80f8f None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:03.755512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 32/66] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:03.761377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c212e-84dd-4ecc-8a02-81da59e73c73 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:03.761709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c212e-84dd-4ecc-8a02-81da59e73c73 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:03.761968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c212e-84dd-4ecc-8a02-81da59e73c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:03.794501 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-b88c212e-84dd-4ecc-8a02-81da59e73c73 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:03.795713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-b88c212e-84dd-4ecc-8a02-81da59e73c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:03.840715 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:03.876760 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 35/67] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:03.932350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345626b-5f45-4e96-b5b2-22231f813243 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:03.932974 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345626b-5f45-4e96-b5b2-22231f813243 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:03.933506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345626b-5f45-4e96-b5b2-22231f813243 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:03.935069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 33/68] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:03.940394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558baf98-9825-4dd7-8d00-8dc490f8b915 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:03.940685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558baf98-9825-4dd7-8d00-8dc490f8b915 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:03.940959 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558baf98-9825-4dd7-8d00-8dc490f8b915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:03.961252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-558baf98-9825-4dd7-8d00-8dc490f8b915 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:03.966527 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-558baf98-9825-4dd7-8d00-8dc490f8b915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:04.016958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345626b-5f45-4e96-b5b2-22231f813243 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.053166 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 36/69] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:04.166405 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345626b-5f45-4e96-b5b2-22231f813243 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.211537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c9b28-21bf-4cc9-a165-8522ae5e45c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.211755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558baf98-9825-4dd7-8d00-8dc490f8b915 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.212177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c9b28-21bf-4cc9-a165-8522ae5e45c0 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.212525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c9b28-21bf-4cc9-a165-8522ae5e45c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.212808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c9b28-21bf-4cc9-a165-8522ae5e45c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.233355 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c9b28-21bf-4cc9-a165-8522ae5e45c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-d11c9b28-21bf-4cc9-a165-8522ae5e45c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:04.239852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:04.240770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:04.241598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 34/70] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:04.250612 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c9b28-21bf-4cc9-a165-8522ae5e45c0 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.312066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:04.340657 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558baf98-9825-4dd7-8d00-8dc490f8b915 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.350849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:04.370782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c9b28-21bf-4cc9-a165-8522ae5e45c0 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.378095 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a61e7-7d18-4e5a-abfa-06d077261617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.378733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a61e7-7d18-4e5a-abfa-06d077261617 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.379019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a61e7-7d18-4e5a-abfa-06d077261617 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.379299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a61e7-7d18-4e5a-abfa-06d077261617 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.391098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a61e7-7d18-4e5a-abfa-06d077261617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-079a61e7-7d18-4e5a-abfa-06d077261617 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:04.396245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:04.397132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:04.397931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 37/71] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:04.398579 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a61e7-7d18-4e5a-abfa-06d077261617 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.411785 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a116f9-ddd0-46f2-ad7a-4d18390b4449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.412706 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a116f9-ddd0-46f2-ad7a-4d18390b4449 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.412996 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a116f9-ddd0-46f2-ad7a-4d18390b4449 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.413448 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a116f9-ddd0-46f2-ad7a-4d18390b4449 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.414112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a116f9-ddd0-46f2-ad7a-4d18390b4449 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:04.414421 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a116f9-ddd0-46f2-ad7a-4d18390b4449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:04.415825 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a116f9-ddd0-46f2-ad7a-4d18390b4449 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:04.424446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 35/72] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:04.425655 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db285462-dfc9-4b01-8fc1-d754f17b8405 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.425943 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db285462-dfc9-4b01-8fc1-d754f17b8405 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.426220 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db285462-dfc9-4b01-8fc1-d754f17b8405 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.427549 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 36/73] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:04.428166 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db285462-dfc9-4b01-8fc1-d754f17b8405 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.516357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a61e7-7d18-4e5a-abfa-06d077261617 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.542572 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db285462-dfc9-4b01-8fc1-d754f17b8405 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.549153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fc3ff-7ad2-446b-97b2-95369d85f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.549820 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fc3ff-7ad2-446b-97b2-95369d85f840 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.550102 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fc3ff-7ad2-446b-97b2-95369d85f840 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.550382 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fc3ff-7ad2-446b-97b2-95369d85f840 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.551608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:04.561980 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fc3ff-7ad2-446b-97b2-95369d85f840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-3f8fc3ff-7ad2-446b-97b2-95369d85f840 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:04.567272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:04.568296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:04.574415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fc3ff-7ad2-446b-97b2-95369d85f840 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.583049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f742a6-9697-476d-81b1-ad30ae5d4e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.583660 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f742a6-9697-476d-81b1-ad30ae5d4e1c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.583944 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f742a6-9697-476d-81b1-ad30ae5d4e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.584224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f742a6-9697-476d-81b1-ad30ae5d4e1c None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.584915 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f742a6-9697-476d-81b1-ad30ae5d4e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:04.585224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f742a6-9697-476d-81b1-ad30ae5d4e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:04.586662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f742a6-9697-476d-81b1-ad30ae5d4e1c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:04.595203 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:04.596450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2a37-db64-4d1b-9c4e-29f366c28243 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.596744 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2a37-db64-4d1b-9c4e-29f366c28243 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.597023 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e2a37-db64-4d1b-9c4e-29f366c28243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.600323 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:04.614327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-952e2a37-db64-4d1b-9c4e-29f366c28243 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:04.615517 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-952e2a37-db64-4d1b-9c4e-29f366c28243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:04.671450 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fc3ff-7ad2-446b-97b2-95369d85f840 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.681043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 38/76] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:04.693555 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e2a37-db64-4d1b-9c4e-29f366c28243 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.707661 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f353-2efb-4490-b96e-1d88faef76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.708307 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f353-2efb-4490-b96e-1d88faef76ed None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.708595 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f353-2efb-4490-b96e-1d88faef76ed None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.708890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f353-2efb-4490-b96e-1d88faef76ed None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.724599 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f353-2efb-4490-b96e-1d88faef76ed None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:04.726254 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f353-2efb-4490-b96e-1d88faef76ed None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:04.727868 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:04.729215 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f353-2efb-4490-b96e-1d88faef76ed None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.788097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:04.791852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e2a37-db64-4d1b-9c4e-29f366c28243 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.816876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:04.827109 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7b732-356f-461c-8417-cecff1208a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.827671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7b732-356f-461c-8417-cecff1208a59 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.827954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7b732-356f-461c-8417-cecff1208a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.828226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7b732-356f-461c-8417-cecff1208a59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.831857 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f353-2efb-4490-b96e-1d88faef76ed None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.839240 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7b732-356f-461c-8417-cecff1208a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-06c7b732-356f-461c-8417-cecff1208a59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:04.844021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:04.844875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:04.845697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 39/78] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:04.846957 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7b732-356f-461c-8417-cecff1208a59 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.872839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.873472 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.873755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.874031 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.874684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:04.874986 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:04.876396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:04.892805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:04.892805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:04.956666 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7b732-356f-461c-8417-cecff1208a59 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:04.992961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ce746-1fdb-4554-b9bb-c282ee14bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:04.993630 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce746-1fdb-4554-b9bb-c282ee14bed3 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:04.994024 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce746-1fdb-4554-b9bb-c282ee14bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:04.994909 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce746-1fdb-4554-b9bb-c282ee14bed3 None admin] PATH_INFO: `/v3/users/bd3642203b2a4a53b69987de767c8bbd` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:04.996054 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ce746-1fdb-4554-b9bb-c282ee14bed3 None admin] RBAC: Authorizing `identity:get_user(user_id=bd3642203b2a4a53b69987de767c8bbd)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:04.997541 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ce746-1fdb-4554-b9bb-c282ee14bed3 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:04.997709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941d57b-165f-40b4-bec3-5e9eb55807d6 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.003963 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 40/80] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/users/bd3642203b2a4a53b69987de767c8bbd => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:05.003963 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ce746-1fdb-4554-b9bb-c282ee14bed3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.030337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.037139 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be9a0-db0f-4025-ac4e-1b911de19707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.041812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be9a0-db0f-4025-ac4e-1b911de19707 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.041812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be9a0-db0f-4025-ac4e-1b911de19707 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.041812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be9a0-db0f-4025-ac4e-1b911de19707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.055672 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.100908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ce746-1fdb-4554-b9bb-c282ee14bed3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.105176 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7be9a0-db0f-4025-ac4e-1b911de19707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.106750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7be9a0-db0f-4025-ac4e-1b911de19707 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.134651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.135805 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.136081 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.136352 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.137008 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:05.137312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.138718 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.146678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 41/81] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:05.147484 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.206886 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 41/82] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:05.208089 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be9a0-db0f-4025-ac4e-1b911de19707 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.241540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.250780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d6a2-39e4-4cf8-9098-c2ab760154f1 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.255850 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.284137 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adacfdb-3a85-41de-b78b-6f63659d644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.284783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacfdb-3a85-41de-b78b-6f63659d644a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.285087 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacfdb-3a85-41de-b78b-6f63659d644a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.285367 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacfdb-3a85-41de-b78b-6f63659d644a None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.286795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adacfdb-3a85-41de-b78b-6f63659d644a None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.288349 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adacfdb-3a85-41de-b78b-6f63659d644a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.289992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 42/83] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:05 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:05.290769 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adacfdb-3a85-41de-b78b-6f63659d644a None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.310606 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be9a0-db0f-4025-ac4e-1b911de19707 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.345551 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454abb95-7a1b-40b0-a6f6-c5e503285e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.346162 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454abb95-7a1b-40b0-a6f6-c5e503285e40 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.346448 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454abb95-7a1b-40b0-a6f6-c5e503285e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.346725 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454abb95-7a1b-40b0-a6f6-c5e503285e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.389863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adacfdb-3a85-41de-b78b-6f63659d644a None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.415349 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454abb95-7a1b-40b0-a6f6-c5e503285e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.417384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454abb95-7a1b-40b0-a6f6-c5e503285e40 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.423999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d787-fea9-494c-9059-5ac078cbe0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.424656 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d787-fea9-494c-9059-5ac078cbe0b6 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.424939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d787-fea9-494c-9059-5ac078cbe0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.425219 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0d787-fea9-494c-9059-5ac078cbe0b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.426349 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0d787-fea9-494c-9059-5ac078cbe0b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.427792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0d787-fea9-494c-9059-5ac078cbe0b6 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.429378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 43/84] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:05.430175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d787-fea9-494c-9059-5ac078cbe0b6 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.458978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.466185 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.517925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 42/85] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:05.518861 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454abb95-7a1b-40b0-a6f6-c5e503285e40 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.536557 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0d787-fea9-494c-9059-5ac078cbe0b6 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.569949 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22056d-9c12-4938-874e-b51d782996b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.570582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22056d-9c12-4938-874e-b51d782996b0 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.570862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22056d-9c12-4938-874e-b51d782996b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.571143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22056d-9c12-4938-874e-b51d782996b0 None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.572814 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22056d-9c12-4938-874e-b51d782996b0 None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.574323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22056d-9c12-4938-874e-b51d782996b0 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.576097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 44/86] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:05 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:05.576742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22056d-9c12-4938-874e-b51d782996b0 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.634148 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454abb95-7a1b-40b0-a6f6-c5e503285e40 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.671064 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1fe44-9fcc-427f-9297-b9415dd931a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.671641 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1fe44-9fcc-427f-9297-b9415dd931a6 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.671927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1fe44-9fcc-427f-9297-b9415dd931a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.672208 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1fe44-9fcc-427f-9297-b9415dd931a6 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.673354 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1fe44-9fcc-427f-9297-b9415dd931a6 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.674842 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1fe44-9fcc-427f-9297-b9415dd931a6 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.676483 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 43/87] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:05 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:05.682148 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1fe44-9fcc-427f-9297-b9415dd931a6 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.688806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.696601 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22056d-9c12-4938-874e-b51d782996b0 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.702336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.730662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936584b1-2ad0-49ee-9bf5-fd0116028414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.731277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936584b1-2ad0-49ee-9bf5-fd0116028414 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.731564 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936584b1-2ad0-49ee-9bf5-fd0116028414 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.731842 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936584b1-2ad0-49ee-9bf5-fd0116028414 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.784834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1fe44-9fcc-427f-9297-b9415dd931a6 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:05.800064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936584b1-2ad0-49ee-9bf5-fd0116028414 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.801600 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936584b1-2ad0-49ee-9bf5-fd0116028414 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.818299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c6d40-e04c-4886-b497-2b760715fc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:05.818904 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6d40-e04c-4886-b497-2b760715fc42 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:05.819184 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6d40-e04c-4886-b497-2b760715fc42 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:05.819455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6d40-e04c-4886-b497-2b760715fc42 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:05.820087 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c6d40-e04c-4886-b497-2b760715fc42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:05.821544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c6d40-e04c-4886-b497-2b760715fc42 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:05.892113 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:05.899434 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 45/88] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:05.900254 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936584b1-2ad0-49ee-9bf5-fd0116028414 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.900926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 44/89] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:48:05 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:48:05.901894 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c6d40-e04c-4886-b497-2b760715fc42 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:05.992819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:06.021326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936584b1-2ad0-49ee-9bf5-fd0116028414 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:06.028390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c6d40-e04c-4886-b497-2b760715fc42 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:06.061400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0ccba-b83a-4254-ac28-3276bc242235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:06.062082 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0ccba-b83a-4254-ac28-3276bc242235 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:06.062371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0ccba-b83a-4254-ac28-3276bc242235 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:06.062650 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0ccba-b83a-4254-ac28-3276bc242235 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:06.063816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0ccba-b83a-4254-ac28-3276bc242235 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:06.065288 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0ccba-b83a-4254-ac28-3276bc242235 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:06.067206 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 46/90] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:05 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:06.067798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0ccba-b83a-4254-ac28-3276bc242235 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:06.073870 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615778c-6d30-44b5-a4e7-30427de6a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:06.074511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615778c-6d30-44b5-a4e7-30427de6a64a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:06.074798 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615778c-6d30-44b5-a4e7-30427de6a64a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:06.075150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615778c-6d30-44b5-a4e7-30427de6a64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:06.143681 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:06.153548 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615778c-6d30-44b5-a4e7-30427de6a64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:06.155021 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615778c-6d30-44b5-a4e7-30427de6a64a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:06.194212 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0ccba-b83a-4254-ac28-3276bc242235 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:06.236091 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:06.237190 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:06.237798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:06.238382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:06.239193 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] RBAC: Adding query filter params (role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=4604492596b94e1c8672d5c858d714f1, user.id=988d7b945dab46e599712b0e1891d3e7) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:06.239587 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:06.241209 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:06.242958 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:06.248313 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 47/91] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:06 2022] GET /identity/v3/role_assignments?user.id=988d7b945dab46e599712b0e1891d3e7&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:06.249148 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:06.281432 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 45/92] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:06.282341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615778c-6d30-44b5-a4e7-30427de6a64a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:06.395433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318909b-b26d-49af-8652-3d6e74107aeb None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:06.403140 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615778c-6d30-44b5-a4e7-30427de6a64a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:06.436228 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:06.441808 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:06.442458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:06.442741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:06.443022 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:06.443764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=4604492596b94e1c8672d5c858d714f1, user.id=bd3642203b2a4a53b69987de767c8bbd) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:06.444085 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:06.445666 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:06.447529 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ca570-196d-45fa-9551-e9938d84a483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:06.448846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca570-196d-45fa-9551-e9938d84a483 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:06.449327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca570-196d-45fa-9551-e9938d84a483 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:06.449843 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ca570-196d-45fa-9551-e9938d84a483 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:06.451780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ca570-196d-45fa-9551-e9938d84a483 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:06.453774 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909ca570-196d-45fa-9551-e9938d84a483 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:06.454646 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 46/93] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:06 2022] GET /identity/v3/role_assignments?user.id=bd3642203b2a4a53b69987de767c8bbd&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=757702b4209942a3b2ec7bf21d995169 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:06.455493 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:06.457532 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 48/94] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:06 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:06.470376 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ca570-196d-45fa-9551-e9938d84a483 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:06.575010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:06.603569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ca570-196d-45fa-9551-e9938d84a483 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:06.647603 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:06.648587 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:06.648967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:06.649337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:06.650490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] RBAC: Adding query filter params (role.id=0e16d3dcd8e045fe89150feef6d93543, scope.project.id=4604492596b94e1c8672d5c858d714f1, user.id=988d7b945dab46e599712b0e1891d3e7) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:06.651087 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:06.657456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:06.660113 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 49/95] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:06 2022] GET /identity/v3/role_assignments?user.id=988d7b945dab46e599712b0e1891d3e7&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=0e16d3dcd8e045fe89150feef6d93543 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:06.717277 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9e92-5ebc-4595-ab7f-7a543ac6dda3 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:06.775255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d64d5-5d9c-4332-ad2f-40fe05557322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:06.776065 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d64d5-5d9c-4332-ad2f-40fe05557322 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:06.776351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d64d5-5d9c-4332-ad2f-40fe05557322 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:06.776633 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d64d5-5d9c-4332-ad2f-40fe05557322 None admin] PATH_INFO: `/v3/projects/a39b655766a7452fb965cbe4c8b3166d` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:06.777927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d64d5-5d9c-4332-ad2f-40fe05557322 None admin] RBAC: Authorizing `identity:get_project(project_id=a39b655766a7452fb965cbe4c8b3166d)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:06.779424 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d64d5-5d9c-4332-ad2f-40fe05557322 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:06.781113 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 47/96] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:06 2022] GET /identity/v3/projects/a39b655766a7452fb965cbe4c8b3166d => generated 312 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:06.787548 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:06.872726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:06.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43371cae-bf2c-4dfa-bcb0-bd318effd019 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:06.978065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff9f9b-edda-45e1-906b-a8fc2b0e6214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:06.978802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff9f9b-edda-45e1-906b-a8fc2b0e6214 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:06.979301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff9f9b-edda-45e1-906b-a8fc2b0e6214 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:06.979671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff9f9b-edda-45e1-906b-a8fc2b0e6214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:06.980400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff9f9b-edda-45e1-906b-a8fc2b0e6214 None admin] RBAC: Adding query filter params (role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=a39b655766a7452fb965cbe4c8b3166d, user.id=988d7b945dab46e599712b0e1891d3e7) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:06.980713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff9f9b-edda-45e1-906b-a8fc2b0e6214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:06.982193 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff9f9b-edda-45e1-906b-a8fc2b0e6214 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:06.988375 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 50/97] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:06 2022] GET /identity/v3/role_assignments?user.id=988d7b945dab46e599712b0e1891d3e7&scope.project.id=a39b655766a7452fb965cbe4c8b3166d&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:09.188678 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1835d-2527-418b-9ec4-39081d1052b3 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:09.189221 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1835d-2527-418b-9ec4-39081d1052b3 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:09.189221 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1835d-2527-418b-9ec4-39081d1052b3 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:09.190616 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 48/98] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:09.195971 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96dc51-2c8c-40cc-9d8d-cb4bf75a13fb None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:09.196381 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96dc51-2c8c-40cc-9d8d-cb4bf75a13fb None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:09.196570 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96dc51-2c8c-40cc-9d8d-cb4bf75a13fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:09.216044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-ca96dc51-2c8c-40cc-9d8d-cb4bf75a13fb None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:09.217400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-ca96dc51-2c8c-40cc-9d8d-cb4bf75a13fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:09.288672 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:09.347791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4ff7-e2cc-4dbc-8286-4206f39b3454 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:09.348098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4ff7-e2cc-4dbc-8286-4206f39b3454 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:09.348459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be4ff7-e2cc-4dbc-8286-4206f39b3454 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:09.350220 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 49/100] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:09.356478 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa58c1-6513-4cf7-9b8b-1076d9094984 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:09.356775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa58c1-6513-4cf7-9b8b-1076d9094984 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:09.357053 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa58c1-6513-4cf7-9b8b-1076d9094984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:09.386436 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-91aa58c1-6513-4cf7-9b8b-1076d9094984 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:09.387645 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-91aa58c1-6513-4cf7-9b8b-1076d9094984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:09.452495 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:09.477913 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 52/101] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:09.526400 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63fee-f9f5-4e54-abea-c20454ef425c None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:09.526693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63fee-f9f5-4e54-abea-c20454ef425c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:09.526969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced63fee-f9f5-4e54-abea-c20454ef425c None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:09.528320 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 50/102] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:09.533628 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04a94-20ad-4ba6-894a-a6834fb5e5c3 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:09.533925 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04a94-20ad-4ba6-894a-a6834fb5e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:09.534210 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04a94-20ad-4ba6-894a-a6834fb5e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:09.553562 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-eec04a94-20ad-4ba6-894a-a6834fb5e5c3 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:09.554753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-eec04a94-20ad-4ba6-894a-a6834fb5e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:09.639934 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 53/103] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:09.741626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d11f-6b0e-46ae-91cd-4842db4ba170 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:09.741932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d11f-6b0e-46ae-91cd-4842db4ba170 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:09.742172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874d11f-6b0e-46ae-91cd-4842db4ba170 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:09.743638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 51/104] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:09.758291 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab11b-9eaa-4ee9-97e3-33445a120c16 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:09.758581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab11b-9eaa-4ee9-97e3-33445a120c16 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:09.758865 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab11b-9eaa-4ee9-97e3-33445a120c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:09.782433 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d11f-6b0e-46ae-91cd-4842db4ba170 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:09.787736 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-64eab11b-9eaa-4ee9-97e3-33445a120c16 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:09.788935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-64eab11b-9eaa-4ee9-97e3-33445a120c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:09.911495 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 54/105] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:09.914456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab11b-9eaa-4ee9-97e3-33445a120c16 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:09.963818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:09.991207 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874d11f-6b0e-46ae-91cd-4842db4ba170 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:09.994805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:10.056811 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5e1f0-d72f-4438-84d6-6d8aca5c83bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.057849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5e1f0-d72f-4438-84d6-6d8aca5c83bf None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.058364 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5e1f0-d72f-4438-84d6-6d8aca5c83bf None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.058838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5e1f0-d72f-4438-84d6-6d8aca5c83bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.065460 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab11b-9eaa-4ee9-97e3-33445a120c16 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.077582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5e1f0-d72f-4438-84d6-6d8aca5c83bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-a5a5e1f0-d72f-4438-84d6-6d8aca5c83bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:10.089153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:10.090088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:10.090890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 52/106] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:10.097190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5e1f0-d72f-4438-84d6-6d8aca5c83bf None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.115801 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d335-bab0-4ea6-a5eb-4de969d980a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.116864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d335-bab0-4ea6-a5eb-4de969d980a0 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.117363 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d335-bab0-4ea6-a5eb-4de969d980a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.117918 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d335-bab0-4ea6-a5eb-4de969d980a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.129694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7d335-bab0-4ea6-a5eb-4de969d980a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-edf7d335-bab0-4ea6-a5eb-4de969d980a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:10.135452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:10.136494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:10.137253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:10.139651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 55/107] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:10.145495 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d335-bab0-4ea6-a5eb-4de969d980a0 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.271156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d335-bab0-4ea6-a5eb-4de969d980a0 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.273998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5e1f0-d72f-4438-84d6-6d8aca5c83bf None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.287316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:10.313005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.313656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.313925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.314208 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.314874 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:10.315178 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:10.316171 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.316577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:10.317235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.317735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.318226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.319087 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:10.319592 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:10.321162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:10.332937 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 53/108] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:10.333369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 56/109] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:10.338849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.340126 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.376586 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:10.454337 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0f59c-bf52-49c7-9e11-198cc8b74550 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.502777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272f8b2-cd76-4eb5-ba46-6615c7593a94 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.529613 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562501e4-3159-486f-9b68-96cc8c03627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.530740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562501e4-3159-486f-9b68-96cc8c03627a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.530740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562501e4-3159-486f-9b68-96cc8c03627a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.530740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562501e4-3159-486f-9b68-96cc8c03627a None admin] PATH_INFO: `/v3/users/c2319bfaa3e8439fa0a68ecfb8ef7552` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.545438 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562501e4-3159-486f-9b68-96cc8c03627a None admin] RBAC: Authorizing `identity:get_user(user_id=c2319bfaa3e8439fa0a68ecfb8ef7552)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:10.546978 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562501e4-3159-486f-9b68-96cc8c03627a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:10.548649 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 54/110] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:10 2022] GET /identity/v3/users/c2319bfaa3e8439fa0a68ecfb8ef7552 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:10.550574 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562501e4-3159-486f-9b68-96cc8c03627a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.552266 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609bdf-5198-4ceb-9fb5-5227caf1170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.553215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609bdf-5198-4ceb-9fb5-5227caf1170c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.553724 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609bdf-5198-4ceb-9fb5-5227caf1170c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.554220 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609bdf-5198-4ceb-9fb5-5227caf1170c None admin] PATH_INFO: `/v3/users/bd3642203b2a4a53b69987de767c8bbd` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.555607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8609bdf-5198-4ceb-9fb5-5227caf1170c None admin] RBAC: Authorizing `identity:get_user(user_id=bd3642203b2a4a53b69987de767c8bbd)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:10.557987 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8609bdf-5198-4ceb-9fb5-5227caf1170c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:10.559731 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 57/111] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:10 2022] GET /identity/v3/users/bd3642203b2a4a53b69987de767c8bbd => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:10.560367 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609bdf-5198-4ceb-9fb5-5227caf1170c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.596140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:10.642823 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:10.658522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562501e4-3159-486f-9b68-96cc8c03627a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.669096 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609bdf-5198-4ceb-9fb5-5227caf1170c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.692924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278fc77-fb42-4cdc-9c33-d04f82f0b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.693604 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fc77-fb42-4cdc-9c33-d04f82f0b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.693917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fc77-fb42-4cdc-9c33-d04f82f0b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.694200 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278fc77-fb42-4cdc-9c33-d04f82f0b6c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.703821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1587b47-35e7-41ab-9c77-07c82331c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.704506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1587b47-35e7-41ab-9c77-07c82331c002 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.704790 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1587b47-35e7-41ab-9c77-07c82331c002 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.704876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278fc77-fb42-4cdc-9c33-d04f82f0b6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:10.705064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1587b47-35e7-41ab-9c77-07c82331c002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.706220 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1587b47-35e7-41ab-9c77-07c82331c002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:10.707706 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1587b47-35e7-41ab-9c77-07c82331c002 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:10.709273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 58/112] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-e278fc77-fb42-4cdc-9c33-d04f82f0b6c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:10.714357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:10.715257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:10.716103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:10.716685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350395e7-bb75-4d5f-9c9d-193dafd72ac2 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.716685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350395e7-bb75-4d5f-9c9d-193dafd72ac2 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.716809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 55/113] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:10.716872 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350395e7-bb75-4d5f-9c9d-193dafd72ac2 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.716934 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278fc77-fb42-4cdc-9c33-d04f82f0b6c3 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.716996 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 59/114] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:10.716996 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350395e7-bb75-4d5f-9c9d-193dafd72ac2 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.817135 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:10.820234 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278fc77-fb42-4cdc-9c33-d04f82f0b6c3 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.820619 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350395e7-bb75-4d5f-9c9d-193dafd72ac2 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.853079 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348172e-9295-4acc-8112-b13273bb032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.854005 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc216c-fa01-4ee7-b259-15b92c854af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.854231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348172e-9295-4acc-8112-b13273bb032b None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.854520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348172e-9295-4acc-8112-b13273bb032b None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.854610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc216c-fa01-4ee7-b259-15b92c854af4 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.854799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348172e-9295-4acc-8112-b13273bb032b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.854901 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc216c-fa01-4ee7-b259-15b92c854af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.855143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc216c-fa01-4ee7-b259-15b92c854af4 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.856241 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc216c-fa01-4ee7-b259-15b92c854af4 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:10.857753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc216c-fa01-4ee7-b259-15b92c854af4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:10.859551 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 60/115] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:10 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:10.860489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1581-258b-42e3-a3b7-10952be8269b None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.860772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1581-258b-42e3-a3b7-10952be8269b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.861049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef1581-258b-42e3-a3b7-10952be8269b None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.862370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 61/116] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:10.862940 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef1581-258b-42e3-a3b7-10952be8269b None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:10.873293 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:10.925920 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348172e-9295-4acc-8112-b13273bb032b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:10.927400 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348172e-9295-4acc-8112-b13273bb032b None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:10.963424 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef1581-258b-42e3-a3b7-10952be8269b None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:10.997546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f543f4d-fddf-473a-b923-f98b6ac74ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:10.998151 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f543f4d-fddf-473a-b923-f98b6ac74ff1 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:10.998433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f543f4d-fddf-473a-b923-f98b6ac74ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:10.998704 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f543f4d-fddf-473a-b923-f98b6ac74ff1 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:10.999336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f543f4d-fddf-473a-b923-f98b6ac74ff1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:11.000783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f543f4d-fddf-473a-b923-f98b6ac74ff1 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:11.023269 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 56/117] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:11.028651 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb78ed-69a4-4076-9dbf-2e3d4eff535e None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:11.028651 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb78ed-69a4-4076-9dbf-2e3d4eff535e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:11.028651 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb78ed-69a4-4076-9dbf-2e3d4eff535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:11.042735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-84fb78ed-69a4-4076-9dbf-2e3d4eff535e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:11.043926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-84fb78ed-69a4-4076-9dbf-2e3d4eff535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:11.088599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 62/118] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:48:10 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:48:11.088599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f543f4d-fddf-473a-b923-f98b6ac74ff1 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:11.088902 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:11.108591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:11.129895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 57/119] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:11.129895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb78ed-69a4-4076-9dbf-2e3d4eff535e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:11.208143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f543f4d-fddf-473a-b923-f98b6ac74ff1 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:11.249158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd49b07-c676-42a4-8083-5ba975e60702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:11.249840 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd49b07-c676-42a4-8083-5ba975e60702 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:11.250390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd49b07-c676-42a4-8083-5ba975e60702 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:11.250674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd49b07-c676-42a4-8083-5ba975e60702 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:11.251439 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd49b07-c676-42a4-8083-5ba975e60702 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:11.252154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd49b07-c676-42a4-8083-5ba975e60702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:11.253608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd49b07-c676-42a4-8083-5ba975e60702 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:11.266440 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 63/120] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:11.267783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b42fcc-23c4-490c-8316-748047b68ee2 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:11.268148 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b42fcc-23c4-490c-8316-748047b68ee2 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:11.268540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b42fcc-23c4-490c-8316-748047b68ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:11.283236 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb78ed-69a4-4076-9dbf-2e3d4eff535e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:11.290572 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-03b42fcc-23c4-490c-8316-748047b68ee2 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:11.292503 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-03b42fcc-23c4-490c-8316-748047b68ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:11.330222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9605b5d-fb1f-45c9-9e0e-1762f5c1b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:11.330734 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605b5d-fb1f-45c9-9e0e-1762f5c1b742 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:11.330838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605b5d-fb1f-45c9-9e0e-1762f5c1b742 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:11.333448 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9605b5d-fb1f-45c9-9e0e-1762f5c1b742 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1/users/bd3642203b2a4a53b69987de767c8bbd/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:11.333448 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9605b5d-fb1f-45c9-9e0e-1762f5c1b742 None admin] RBAC: Authorizing `identity:create_grant(project_id=4604492596b94e1c8672d5c858d714f1, user_id=bd3642203b2a4a53b69987de767c8bbd, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:11.334583 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9605b5d-fb1f-45c9-9e0e-1762f5c1b742 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:11.372848 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 64/121] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:11.373772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b42fcc-23c4-490c-8316-748047b68ee2 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:11.391457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:11.425301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 58/122] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:11 2022] PUT /identity/v3/projects/4604492596b94e1c8672d5c858d714f1/users/bd3642203b2a4a53b69987de767c8bbd/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:11.426191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9605b5d-fb1f-45c9-9e0e-1762f5c1b742 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:11.493981 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b42fcc-23c4-490c-8316-748047b68ee2 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:11.522048 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:11.537111 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b4c2c-5127-4d01-bc87-e06bc0cb80c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:11.537815 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4c2c-5127-4d01-bc87-e06bc0cb80c9 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:11.538109 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4c2c-5127-4d01-bc87-e06bc0cb80c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:11.538454 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b4c2c-5127-4d01-bc87-e06bc0cb80c9 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:11.539721 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b4c2c-5127-4d01-bc87-e06bc0cb80c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:11.541519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b4c2c-5127-4d01-bc87-e06bc0cb80c9 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:11.543282 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 65/123] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:11 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:11.544261 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b4c2c-5127-4d01-bc87-e06bc0cb80c9 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:11.653027 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9605b5d-fb1f-45c9-9e0e-1762f5c1b742 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:11.689807 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:11.710333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a80b2-eda8-4c8e-b8f1-bdfab046e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:11.711045 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a80b2-eda8-4c8e-b8f1-bdfab046e25c None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:11.711327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a80b2-eda8-4c8e-b8f1-bdfab046e25c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:11.711603 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a80b2-eda8-4c8e-b8f1-bdfab046e25c None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:11.712042 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b4c2c-5127-4d01-bc87-e06bc0cb80c9 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:11.713975 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a80b2-eda8-4c8e-b8f1-bdfab046e25c None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:11.716542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a80b2-eda8-4c8e-b8f1-bdfab046e25c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:11.718388 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 59/124] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:11 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:11.719169 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a80b2-eda8-4c8e-b8f1-bdfab046e25c None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:11.829915 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b53fd-f7b9-4288-9e9a-a8378e77ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:11.831164 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b53fd-f7b9-4288-9e9a-a8378e77ce2b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:11.831662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b53fd-f7b9-4288-9e9a-a8378e77ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:11.832265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b53fd-f7b9-4288-9e9a-a8378e77ce2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:11.832468 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a80b2-eda8-4c8e-b8f1-bdfab046e25c None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:11.834134 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:11.848456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b53fd-f7b9-4288-9e9a-a8378e77ce2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-1c2b53fd-f7b9-4288-9e9a-a8378e77ce2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:11.855858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:11.856710 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:11.857490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:11.863406 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 66/125] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:11.863406 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b53fd-f7b9-4288-9e9a-a8378e77ce2b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:11.877572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:11.878190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:11.878499 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:11.878744 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:11.879475 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] RBAC: Adding query filter params (role.id=0c2da9b50ef4450c98676939632e93b6, scope.project.id=4604492596b94e1c8672d5c858d714f1, user.id=c2319bfaa3e8439fa0a68ecfb8ef7552) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:11.879842 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:11.881477 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:11.889765 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 60/126] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:11 2022] GET /identity/v3/role_assignments?user.id=c2319bfaa3e8439fa0a68ecfb8ef7552&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=0c2da9b50ef4450c98676939632e93b6 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:11.890607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.038754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574a2d-3ee0-4772-8f62-225ddae7f0b3 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:12.042079 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b53fd-f7b9-4288-9e9a-a8378e77ce2b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:12.080459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab94210-880c-4760-815f-fd6f21421e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:12.081527 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94210-880c-4760-815f-fd6f21421e33 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:12.082004 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94210-880c-4760-815f-fd6f21421e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:12.082472 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab94210-880c-4760-815f-fd6f21421e33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:12.094718 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab94210-880c-4760-815f-fd6f21421e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-fab94210-880c-4760-815f-fd6f21421e33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:12.099950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:12.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:12.102318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:12.104873 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 61/127] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:12.110119 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab94210-880c-4760-815f-fd6f21421e33 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.124693 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066ef2-2d52-4da6-9e31-fb5ded463c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:12.125467 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066ef2-2d52-4da6-9e31-fb5ded463c08 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:12.125747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066ef2-2d52-4da6-9e31-fb5ded463c08 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:12.126024 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f066ef2-2d52-4da6-9e31-fb5ded463c08 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:12.128051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f066ef2-2d52-4da6-9e31-fb5ded463c08 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:12.129550 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f066ef2-2d52-4da6-9e31-fb5ded463c08 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:12.131389 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 67/128] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:11 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:12.132047 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066ef2-2d52-4da6-9e31-fb5ded463c08 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.145257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:12.152341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:12.225112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab94210-880c-4760-815f-fd6f21421e33 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:12.257975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f066ef2-2d52-4da6-9e31-fb5ded463c08 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:12.263936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:12.264552 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:12.264832 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:12.265104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:12.265912 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:12.266218 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:12.267792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:12.278050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 62/129] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:12.278625 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.298984 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:12.300241 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:12.300724 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:12.301211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:12.302107 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:12.302626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:12.304266 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:12.317452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 68/130] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:12.318675 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.397849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:12.409443 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec5c37-c20c-4fe3-9fce-25c221289cfc None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:12.439900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb805c-be5b-4386-ac9e-5db9a46b8969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:12.440440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb805c-be5b-4386-ac9e-5db9a46b8969 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:12.440722 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb805c-be5b-4386-ac9e-5db9a46b8969 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:12.440998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb805c-be5b-4386-ac9e-5db9a46b8969 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1/users/988d7b945dab46e599712b0e1891d3e7/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:12.443006 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb805c-be5b-4386-ac9e-5db9a46b8969 None admin] RBAC: Authorizing `identity:create_grant(project_id=4604492596b94e1c8672d5c858d714f1, user_id=988d7b945dab46e599712b0e1891d3e7, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:12.444542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb805c-be5b-4386-ac9e-5db9a46b8969 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:12.459464 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:12.505237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d79fd-96f0-4958-9db7-ed0d9583f10a None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:12.523915 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 63/131] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:12 2022] PUT /identity/v3/projects/4604492596b94e1c8672d5c858d714f1/users/988d7b945dab46e599712b0e1891d3e7/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:12.524762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb805c-be5b-4386-ac9e-5db9a46b8969 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.544356 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea77f-366d-4262-98e2-d52b43247f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:12.545356 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea77f-366d-4262-98e2-d52b43247f62 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:12.545913 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea77f-366d-4262-98e2-d52b43247f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:12.548625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea77f-366d-4262-98e2-d52b43247f62 None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:12.551764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea77f-366d-4262-98e2-d52b43247f62 None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:12.554371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea77f-366d-4262-98e2-d52b43247f62 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:12.557153 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 69/132] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:12 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:12.564965 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea77f-366d-4262-98e2-d52b43247f62 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.749194 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb805c-be5b-4386-ac9e-5db9a46b8969 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:12.796862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea77f-366d-4262-98e2-d52b43247f62 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:12.811382 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c5aa-525f-4034-b564-b22c37e4a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:12.811974 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c5aa-525f-4034-b564-b22c37e4a39e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:12.812262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c5aa-525f-4034-b564-b22c37e4a39e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:12.812541 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4c5aa-525f-4034-b564-b22c37e4a39e None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:12.816289 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4c5aa-525f-4034-b564-b22c37e4a39e None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:12.817901 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4c5aa-525f-4034-b564-b22c37e4a39e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:12.820010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 64/133] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:12 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:12.826805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c5aa-525f-4034-b564-b22c37e4a39e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.857877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074020e9-cdd7-4069-8e36-0ae052510534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:12.858860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074020e9-cdd7-4069-8e36-0ae052510534 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:12.859313 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074020e9-cdd7-4069-8e36-0ae052510534 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:12.859753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074020e9-cdd7-4069-8e36-0ae052510534 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:12.861226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074020e9-cdd7-4069-8e36-0ae052510534 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:12.863750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074020e9-cdd7-4069-8e36-0ae052510534 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:12.864904 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:12.871027 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 70/134] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:12 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:12.874495 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074020e9-cdd7-4069-8e36-0ae052510534 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:12.890537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:13.010185 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4c5aa-525f-4034-b564-b22c37e4a39e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:13.078416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074020e9-cdd7-4069-8e36-0ae052510534 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:13.094245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a431c88-2b28-445b-be0c-a679819da7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:13.094896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431c88-2b28-445b-be0c-a679819da7b3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:13.095175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431c88-2b28-445b-be0c-a679819da7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:13.095447 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a431c88-2b28-445b-be0c-a679819da7b3 None admin] PATH_INFO: `/v3/projects/a39b655766a7452fb965cbe4c8b3166d` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:13.097618 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a431c88-2b28-445b-be0c-a679819da7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=a39b655766a7452fb965cbe4c8b3166d)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:13.099078 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a431c88-2b28-445b-be0c-a679819da7b3 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:13.100983 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 65/135] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:12 2022] GET /identity/v3/projects/a39b655766a7452fb965cbe4c8b3166d => generated 312 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:13.108013 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a431c88-2b28-445b-be0c-a679819da7b3 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:13.165240 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24279c6-50c4-4a25-8da8-bb9c00c0b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:13.166158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24279c6-50c4-4a25-8da8-bb9c00c0b116 None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:13.166618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24279c6-50c4-4a25-8da8-bb9c00c0b116 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:13.166898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24279c6-50c4-4a25-8da8-bb9c00c0b116 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1/users/988d7b945dab46e599712b0e1891d3e7/roles/0e16d3dcd8e045fe89150feef6d93543` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:13.170003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24279c6-50c4-4a25-8da8-bb9c00c0b116 None admin] RBAC: Authorizing `identity:create_grant(project_id=4604492596b94e1c8672d5c858d714f1, user_id=988d7b945dab46e599712b0e1891d3e7, role_id=0e16d3dcd8e045fe89150feef6d93543)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:13.171449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24279c6-50c4-4a25-8da8-bb9c00c0b116 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:13.258727 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:13.281279 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a431c88-2b28-445b-be0c-a679819da7b3 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:13.312135 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 71/136] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:12 2022] PUT /identity/v3/projects/4604492596b94e1c8672d5c858d714f1/users/988d7b945dab46e599712b0e1891d3e7/roles/0e16d3dcd8e045fe89150feef6d93543 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:48:13.347057 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8708-a0da-4348-8939-e231f3eb4df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:13.347685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8708-a0da-4348-8939-e231f3eb4df7 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:13.347973 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8708-a0da-4348-8939-e231f3eb4df7 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:13.348251 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8708-a0da-4348-8939-e231f3eb4df7 None admin] PATH_INFO: `/v3/projects/a39b655766a7452fb965cbe4c8b3166d/users/988d7b945dab46e599712b0e1891d3e7/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:13.350233 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8708-a0da-4348-8939-e231f3eb4df7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a39b655766a7452fb965cbe4c8b3166d, user_id=988d7b945dab46e599712b0e1891d3e7, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:13.351701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8708-a0da-4348-8939-e231f3eb4df7 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:13.445906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 66/137] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:13 2022] PUT /identity/v3/projects/a39b655766a7452fb965cbe4c8b3166d/users/988d7b945dab46e599712b0e1891d3e7/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:14.052662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd1d7-cb34-4e00-9dc3-f6d648ff3ba6 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:14.052958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd1d7-cb34-4e00-9dc3-f6d648ff3ba6 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:14.053233 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccd1d7-cb34-4e00-9dc3-f6d648ff3ba6 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:14.054821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 72/138] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:14.060054 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e618ba2-4756-4522-ae2d-56c2a269892f None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:14.060349 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e618ba2-4756-4522-ae2d-56c2a269892f None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:14.060630 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e618ba2-4756-4522-ae2d-56c2a269892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:14.086351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-1e618ba2-4756-4522-ae2d-56c2a269892f None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:14.088178 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-1e618ba2-4756-4522-ae2d-56c2a269892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:14.187013 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 67/139] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:14.443636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d4d05-f3d1-455d-b0d7-0792bdca60a7 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:14.444174 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d4d05-f3d1-455d-b0d7-0792bdca60a7 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:14.444174 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d4d05-f3d1-455d-b0d7-0792bdca60a7 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:14.445532 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 73/140] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:14.458777 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59c1b-68a2-4f5c-b4a6-0cffc386b62b None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:14.459217 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59c1b-68a2-4f5c-b4a6-0cffc386b62b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:14.459411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59c1b-68a2-4f5c-b4a6-0cffc386b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:14.486337 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-65f59c1b-68a2-4f5c-b4a6-0cffc386b62b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:14.487558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-65f59c1b-68a2-4f5c-b4a6-0cffc386b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:14.581630 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 68/141] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:14.861884 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d4d05-f3d1-455d-b0d7-0792bdca60a7 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:14.951084 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:14.993615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d4d05-f3d1-455d-b0d7-0792bdca60a7 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:15.039052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c07173-c1b7-43f9-a355-2105fc766494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:15.039699 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07173-c1b7-43f9-a355-2105fc766494 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.039980 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07173-c1b7-43f9-a355-2105fc766494 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.040254 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07173-c1b7-43f9-a355-2105fc766494 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.042268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c07173-c1b7-43f9-a355-2105fc766494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:15.043733 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c07173-c1b7-43f9-a355-2105fc766494 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:15.045328 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 74/142] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:15.050902 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f59c1b-68a2-4f5c-b4a6-0cffc386b62b None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:15.054679 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:15.122781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c07173-c1b7-43f9-a355-2105fc766494 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:15.183797 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f59c1b-68a2-4f5c-b4a6-0cffc386b62b None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:15.225019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7789ab0-457f-4e35-a757-555bf28978fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:15.226001 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789ab0-457f-4e35-a757-555bf28978fc None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.226494 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789ab0-457f-4e35-a757-555bf28978fc None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.227023 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789ab0-457f-4e35-a757-555bf28978fc None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.228619 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7789ab0-457f-4e35-a757-555bf28978fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:15.230312 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7789ab0-457f-4e35-a757-555bf28978fc None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:15.324853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c07173-c1b7-43f9-a355-2105fc766494 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:15.346894 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 69/143] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:48:15 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:48:15.348667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933240c-8324-4e83-9dc3-7e0fce16fd72 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.349170 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933240c-8324-4e83-9dc3-7e0fce16fd72 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.349679 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933240c-8324-4e83-9dc3-7e0fce16fd72 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.351247 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 70/144] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:15.369898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901fb2-284d-43ae-943e-e750e42c9548 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.370615 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901fb2-284d-43ae-943e-e750e42c9548 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.371103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d901fb2-284d-43ae-943e-e750e42c9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.393916 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-8d901fb2-284d-43ae-943e-e750e42c9548 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:15.395774 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-8d901fb2-284d-43ae-943e-e750e42c9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:15.411449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa71654-2e38-42a6-81b8-029a62a57864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:15.411891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa71654-2e38-42a6-81b8-029a62a57864 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.412225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa71654-2e38-42a6-81b8-029a62a57864 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.412502 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa71654-2e38-42a6-81b8-029a62a57864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.419633 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:15.445208 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa71654-2e38-42a6-81b8-029a62a57864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-3aa71654-2e38-42a6-81b8-029a62a57864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:15.447764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:15.448651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:15.449468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:15.453589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 75/145] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:15.455261 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa71654-2e38-42a6-81b8-029a62a57864 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:15.480166 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:15.502984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 71/146] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:15.583424 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ef37-ccbf-411a-8f49-d0f2daa83dfb None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.583761 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ef37-ccbf-411a-8f49-d0f2daa83dfb None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.584000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635ef37-ccbf-411a-8f49-d0f2daa83dfb None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.589798 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 72/147] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:15.592146 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa11ac-335d-4cdb-b4d1-15fe5c34895f None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.592434 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa11ac-335d-4cdb-b4d1-15fe5c34895f None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.592714 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa11ac-335d-4cdb-b4d1-15fe5c34895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.630457 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-a3fa11ac-335d-4cdb-b4d1-15fe5c34895f None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:15.631664 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-a3fa11ac-335d-4cdb-b4d1-15fe5c34895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:15.654673 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa71654-2e38-42a6-81b8-029a62a57864 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:15.710092 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:15.710702 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.710981 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.711254 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.711913 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:15.712215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:15.713666 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:15.731971 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 76/148] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:15.736539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:15.770966 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 73/149] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:15.816712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:15.875696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa44a3c-5059-445c-8c1e-7bc3808f4cef None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:15.926224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980e2d-5238-4a2a-8f08-dd4c4c014a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:15.926798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980e2d-5238-4a2a-8f08-dd4c4c014a8c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:15.927078 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980e2d-5238-4a2a-8f08-dd4c4c014a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:15.927354 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2980e2d-5238-4a2a-8f08-dd4c4c014a8c None admin] PATH_INFO: `/v3/users/bd3642203b2a4a53b69987de767c8bbd` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:15.928649 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2980e2d-5238-4a2a-8f08-dd4c4c014a8c None admin] RBAC: Authorizing `identity:get_user(user_id=bd3642203b2a4a53b69987de767c8bbd)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:15.930137 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2980e2d-5238-4a2a-8f08-dd4c4c014a8c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:15.932705 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 77/150] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:15 2022] GET /identity/v3/users/bd3642203b2a4a53b69987de767c8bbd => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:15.938106 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa11ac-335d-4cdb-b4d1-15fe5c34895f None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:15.984381 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980e2d-5238-4a2a-8f08-dd4c4c014a8c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.115405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa11ac-335d-4cdb-b4d1-15fe5c34895f None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:16.124104 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2980e2d-5238-4a2a-8f08-dd4c4c014a8c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:16.144599 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:16.153649 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:16.165678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c10caa-2252-4bba-b4c7-f9a8a8c6155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:16.166962 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c10caa-2252-4bba-b4c7-f9a8a8c6155c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:16.167459 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c10caa-2252-4bba-b4c7-f9a8a8c6155c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:16.168098 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c10caa-2252-4bba-b4c7-f9a8a8c6155c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:16.169150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83937d9c-e879-429e-8cf0-ad3bfd27e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:16.169849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83937d9c-e879-429e-8cf0-ad3bfd27e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:16.170131 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83937d9c-e879-429e-8cf0-ad3bfd27e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:16.170405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83937d9c-e879-429e-8cf0-ad3bfd27e5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:16.182820 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c10caa-2252-4bba-b4c7-f9a8a8c6155c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-f4c10caa-2252-4bba-b4c7-f9a8a8c6155c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:16.187911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:16.188761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:16.189596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 78/151] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:16.191099 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c10caa-2252-4bba-b4c7-f9a8a8c6155c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.260437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83937d9c-e879-429e-8cf0-ad3bfd27e5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:16.261941 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83937d9c-e879-429e-8cf0-ad3bfd27e5b9 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:16.303271 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c10caa-2252-4bba-b4c7-f9a8a8c6155c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:16.342269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f14fb2-ac67-471d-b3dc-07cf5261727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:16.342917 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f14fb2-ac67-471d-b3dc-07cf5261727e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:16.343195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f14fb2-ac67-471d-b3dc-07cf5261727e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:16.343467 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f14fb2-ac67-471d-b3dc-07cf5261727e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:16.355127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f14fb2-ac67-471d-b3dc-07cf5261727e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-54f14fb2-ac67-471d-b3dc-07cf5261727e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:16.360542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:16.361379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:16.362400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 79/152] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:16.364022 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f14fb2-ac67-471d-b3dc-07cf5261727e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.374740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 74/153] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:16.375602 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83937d9c-e879-429e-8cf0-ad3bfd27e5b9 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.398113 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:16.415948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:16.484882 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f14fb2-ac67-471d-b3dc-07cf5261727e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:16.491884 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83937d9c-e879-429e-8cf0-ad3bfd27e5b9 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:16.527597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:16.528558 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:16.529077 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:16.529529 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:16.530001 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:16.530504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:16.530622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:16.530887 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:16.531166 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:16.531323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:16.531832 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] RBAC: Adding query filter params (name=member) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:16.532138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:16.533130 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:16.533534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:16.542881 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 75/154] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:16.543314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 80/155] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:16.545547 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.549698 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.633883 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:16.651431 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30284a79-6a64-455f-bad2-efa8322347fa None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:16.701558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb21d94-7f14-4ce5-8fb1-c0306ea61d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:16.702494 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb21d94-7f14-4ce5-8fb1-c0306ea61d0a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:16.702944 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb21d94-7f14-4ce5-8fb1-c0306ea61d0a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:16.703365 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb21d94-7f14-4ce5-8fb1-c0306ea61d0a None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:16.706262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb21d94-7f14-4ce5-8fb1-c0306ea61d0a None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:16.708086 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb21d94-7f14-4ce5-8fb1-c0306ea61d0a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:16.713006 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 76/156] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:16 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:16.715565 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb21d94-7f14-4ce5-8fb1-c0306ea61d0a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.734617 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f4561-c9c5-4aaa-bb91-aa5aa4bab611 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:16.750223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:16.826203 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5b7f1-0bae-405d-b30c-568f4e1a1ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:16.826865 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b7f1-0bae-405d-b30c-568f4e1a1ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:16.827149 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b7f1-0bae-405d-b30c-568f4e1a1ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:16.827422 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5b7f1-0bae-405d-b30c-568f4e1a1ab4 None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:16.828665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5b7f1-0bae-405d-b30c-568f4e1a1ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:16.830229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5b7f1-0bae-405d-b30c-568f4e1a1ab4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:16.832808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 81/157] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:16 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:16.833679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5b7f1-0bae-405d-b30c-568f4e1a1ab4 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.873855 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb21d94-7f14-4ce5-8fb1-c0306ea61d0a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:16.914934 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d6d08-8204-4983-aafd-f4a0954884fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:16.916175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d6d08-8204-4983-aafd-f4a0954884fa None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:16.916460 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d6d08-8204-4983-aafd-f4a0954884fa None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:16.916733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d6d08-8204-4983-aafd-f4a0954884fa None admin] PATH_INFO: `/v3/users/c2319bfaa3e8439fa0a68ecfb8ef7552` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:16.917932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d6d08-8204-4983-aafd-f4a0954884fa None admin] RBAC: Authorizing `identity:get_user(user_id=c2319bfaa3e8439fa0a68ecfb8ef7552)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:16.919459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d6d08-8204-4983-aafd-f4a0954884fa None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:16.921326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 77/158] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:16 2022] GET /identity/v3/users/c2319bfaa3e8439fa0a68ecfb8ef7552 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:16.922121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d6d08-8204-4983-aafd-f4a0954884fa None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:16.956028 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:17.025601 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5b7f1-0bae-405d-b30c-568f4e1a1ab4 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:17.040081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d6d08-8204-4983-aafd-f4a0954884fa None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:17.062126 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeca7b-013d-4e97-bb5c-328f905754fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:17.062800 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeca7b-013d-4e97-bb5c-328f905754fb None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.064016 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeca7b-013d-4e97-bb5c-328f905754fb None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.064294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeca7b-013d-4e97-bb5c-328f905754fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.065019 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeca7b-013d-4e97-bb5c-328f905754fb None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=4604492596b94e1c8672d5c858d714f1, user.id=bd3642203b2a4a53b69987de767c8bbd) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:17.065507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeca7b-013d-4e97-bb5c-328f905754fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:17.068101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeca7b-013d-4e97-bb5c-328f905754fb None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:17.074159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 82/159] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:16 2022] GET /identity/v3/role_assignments?user.id=bd3642203b2a4a53b69987de767c8bbd&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=757702b4209942a3b2ec7bf21d995169 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:17.075405 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726f8de-ca00-442c-8c03-a50edd9c56c4 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.075685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726f8de-ca00-442c-8c03-a50edd9c56c4 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.075955 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726f8de-ca00-442c-8c03-a50edd9c56c4 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.077329 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 83/160] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:17.079979 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726f8de-ca00-442c-8c03-a50edd9c56c4 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:17.094953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f560-1b65-4fce-9072-ec00d73ce149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:17.095696 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f560-1b65-4fce-9072-ec00d73ce149 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f560-1b65-4fce-9072-ec00d73ce149 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.096263 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430f560-1b65-4fce-9072-ec00d73ce149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.135411 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:17.205018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726f8de-ca00-442c-8c03-a50edd9c56c4 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:17.245398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747149c1-d46d-4615-920d-a6bf7dc5910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:17.246133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747149c1-d46d-4615-920d-a6bf7dc5910a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.246414 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747149c1-d46d-4615-920d-a6bf7dc5910a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.246740 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747149c1-d46d-4615-920d-a6bf7dc5910a None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.248187 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747149c1-d46d-4615-920d-a6bf7dc5910a None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:17.249689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747149c1-d46d-4615-920d-a6bf7dc5910a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:17.251620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 84/161] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:17 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:17.252853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1756c-9248-4e9d-bbe5-9d3deb5b5fcb None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.253204 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1756c-9248-4e9d-bbe5-9d3deb5b5fcb None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.253396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1756c-9248-4e9d-bbe5-9d3deb5b5fcb None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.254818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 85/162] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:17.255744 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f560-1b65-4fce-9072-ec00d73ce149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:17.255857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd71a1-3316-49b8-b3fd-0c78a2701e74 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.256068 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd71a1-3316-49b8-b3fd-0c78a2701e74 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.256338 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd71a1-3316-49b8-b3fd-0c78a2701e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.257371 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430f560-1b65-4fce-9072-ec00d73ce149 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:17.277125 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-79cd71a1-3316-49b8-b3fd-0c78a2701e74 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:17.278418 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-79cd71a1-3316-49b8-b3fd-0c78a2701e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:17.314780 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:17.367874 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 86/163] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:17.370614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474ae6-dcf6-469c-8832-95e0d2d46da9 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.371091 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474ae6-dcf6-469c-8832-95e0d2d46da9 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.371514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b474ae6-dcf6-469c-8832-95e0d2d46da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.401910 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-8b474ae6-dcf6-469c-8832-95e0d2d46da9 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:17.403462 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-8b474ae6-dcf6-469c-8832-95e0d2d46da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:17.453806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:17.506424 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 87/164] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:17.507257 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b474ae6-dcf6-469c-8832-95e0d2d46da9 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:17.589768 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 78/165] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:17.606975 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f560-1b65-4fce-9072-ec00d73ce149 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:17.640821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b474ae6-dcf6-469c-8832-95e0d2d46da9 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:17.683183 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73a2af-3c1c-44b8-bdb0-b16dcd4c3350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:17.683855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a2af-3c1c-44b8-bdb0-b16dcd4c3350 None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.684131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a2af-3c1c-44b8-bdb0-b16dcd4c3350 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.684404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a2af-3c1c-44b8-bdb0-b16dcd4c3350 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1/users/c2319bfaa3e8439fa0a68ecfb8ef7552/roles/0c2da9b50ef4450c98676939632e93b6` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.686430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73a2af-3c1c-44b8-bdb0-b16dcd4c3350 None admin] RBAC: Authorizing `identity:create_grant(project_id=4604492596b94e1c8672d5c858d714f1, user_id=c2319bfaa3e8439fa0a68ecfb8ef7552, role_id=0c2da9b50ef4450c98676939632e93b6)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:17.688108 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73a2af-3c1c-44b8-bdb0-b16dcd4c3350 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:17.760446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 88/166] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:17 2022] PUT /identity/v3/projects/4604492596b94e1c8672d5c858d714f1/users/c2319bfaa3e8439fa0a68ecfb8ef7552/roles/0c2da9b50ef4450c98676939632e93b6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:17.780624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430f560-1b65-4fce-9072-ec00d73ce149 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:17.811428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:17.836215 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaef7dd-4203-4d07-9e00-36eae7a3bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:17.836904 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaef7dd-4203-4d07-9e00-36eae7a3bf31 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:17.837225 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaef7dd-4203-4d07-9e00-36eae7a3bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:17.838075 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaef7dd-4203-4d07-9e00-36eae7a3bf31 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:17.842267 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaef7dd-4203-4d07-9e00-36eae7a3bf31 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:17.844104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaef7dd-4203-4d07-9e00-36eae7a3bf31 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:17.846470 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 79/167] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:17 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:17.852238 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73a2af-3c1c-44b8-bdb0-b16dcd4c3350 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:17.897430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:18.003786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73a2af-3c1c-44b8-bdb0-b16dcd4c3350 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:18.055169 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:18.055790 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:18.056694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:18.057174 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:18.058040 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] RBAC: Adding query filter params (role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=4604492596b94e1c8672d5c858d714f1, user.id=988d7b945dab46e599712b0e1891d3e7) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:18.058347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:18.059816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:18.066608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 89/168] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:17 2022] GET /identity/v3/role_assignments?user.id=988d7b945dab46e599712b0e1891d3e7&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:18.088162 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaef7dd-4203-4d07-9e00-36eae7a3bf31 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:18.141542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:18.267362 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaef7dd-4203-4d07-9e00-36eae7a3bf31 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:18.313786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:18.326708 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60727610-4bfd-4272-8ad8-b31a763ed12f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:18.341579 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448f450-0222-41f7-9b49-24437a3ea92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:18.342239 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448f450-0222-41f7-9b49-24437a3ea92d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:18.342514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448f450-0222-41f7-9b49-24437a3ea92d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:18.342781 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448f450-0222-41f7-9b49-24437a3ea92d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:18.357658 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448f450-0222-41f7-9b49-24437a3ea92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-e448f450-0222-41f7-9b49-24437a3ea92d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:18.364172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:18.367256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:18.368044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 80/169] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:18.373090 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448f450-0222-41f7-9b49-24437a3ea92d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:18.396624 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c653cf-b0a6-4831-98b1-053ce8e991bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:18.396624 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c653cf-b0a6-4831-98b1-053ce8e991bf None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:18.396624 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c653cf-b0a6-4831-98b1-053ce8e991bf None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:18.396624 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c653cf-b0a6-4831-98b1-053ce8e991bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:18.419509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c653cf-b0a6-4831-98b1-053ce8e991bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-f1c653cf-b0a6-4831-98b1-053ce8e991bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:18.425044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:18.426195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:18.427258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:18.434323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 90/170] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:18.440150 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c653cf-b0a6-4831-98b1-053ce8e991bf None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:18.449187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:18.599457 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448f450-0222-41f7-9b49-24437a3ea92d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:18.691073 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c653cf-b0a6-4831-98b1-053ce8e991bf None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:18.695846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:18.697351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:18.697876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:18.698345 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:18.699214 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:18.699721 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:18.702175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:18.713679 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 81/171] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:18.719562 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:18.736953 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:18.740198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:18.742095 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:18.743308 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:18.745029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:18.748863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:18.750705 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:18.770344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 91/172] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:18.777022 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:18.805563 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:18.924231 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f436a-69b1-4070-a165-e274cf5c7b78 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:18.942150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f6b9d-0193-4a53-b621-3dc540a41e45 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:18.954229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:18.991639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6e289-efbb-4710-b1cf-622fc2f61ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:18.991639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e289-efbb-4710-b1cf-622fc2f61ea2 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:18.991639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e289-efbb-4710-b1cf-622fc2f61ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:18.991639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6e289-efbb-4710-b1cf-622fc2f61ea2 None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:18.995879 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce2ce2-71ef-4add-9dfd-c5bf22eb6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:18.996629 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce2ce2-71ef-4add-9dfd-c5bf22eb6a18 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:18.996990 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce2ce2-71ef-4add-9dfd-c5bf22eb6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:18.997193 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6e289-efbb-4710-b1cf-622fc2f61ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:18.997349 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce2ce2-71ef-4add-9dfd-c5bf22eb6a18 None admin] PATH_INFO: `/v3/users/988d7b945dab46e599712b0e1891d3e7` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:18.998644 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce2ce2-71ef-4add-9dfd-c5bf22eb6a18 None admin] RBAC: Authorizing `identity:get_user(user_id=988d7b945dab46e599712b0e1891d3e7)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:18.999464 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6e289-efbb-4710-b1cf-622fc2f61ea2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:19.000290 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce2ce2-71ef-4add-9dfd-c5bf22eb6a18 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:19.001838 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 92/173] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:18 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:19.002893 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 82/174] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:18 2022] GET /identity/v3/users/988d7b945dab46e599712b0e1891d3e7 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:19.006959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6e289-efbb-4710-b1cf-622fc2f61ea2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:19.014975 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce2ce2-71ef-4add-9dfd-c5bf22eb6a18 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:19.098067 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:19.117215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6e289-efbb-4710-b1cf-622fc2f61ea2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:19.155134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dab79-813b-45ad-bdd8-d501ccd7d314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:19.156119 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dab79-813b-45ad-bdd8-d501ccd7d314 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:19.156603 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dab79-813b-45ad-bdd8-d501ccd7d314 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:19.157106 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dab79-813b-45ad-bdd8-d501ccd7d314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:19.229563 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dab79-813b-45ad-bdd8-d501ccd7d314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:19.231402 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dab79-813b-45ad-bdd8-d501ccd7d314 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:19.242858 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce2ce2-71ef-4add-9dfd-c5bf22eb6a18 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:19.302539 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d7b1f-e0d3-41b6-97af-532e2058e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:19.303720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d7b1f-e0d3-41b6-97af-532e2058e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:19.303720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d7b1f-e0d3-41b6-97af-532e2058e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:19.304019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d7b1f-e0d3-41b6-97af-532e2058e7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:19.322000 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:19.343499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 93/175] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:19.354011 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dab79-813b-45ad-bdd8-d501ccd7d314 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:19.373230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:19.393995 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d7b1f-e0d3-41b6-97af-532e2058e7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:19.395585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d7b1f-e0d3-41b6-97af-532e2058e7a2 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:19.486473 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dab79-813b-45ad-bdd8-d501ccd7d314 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:19.527482 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 83/176] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:19.533052 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d7b1f-e0d3-41b6-97af-532e2058e7a2 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:19.537485 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8120f-7768-4026-8906-18f50e0ec2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:19.537639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8120f-7768-4026-8906-18f50e0ec2ed None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:19.537995 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8120f-7768-4026-8906-18f50e0ec2ed None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:19.538361 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8120f-7768-4026-8906-18f50e0ec2ed None admin] PATH_INFO: `/v3/projects/a39b655766a7452fb965cbe4c8b3166d` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:19.539711 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8120f-7768-4026-8906-18f50e0ec2ed None admin] RBAC: Authorizing `identity:get_project(project_id=a39b655766a7452fb965cbe4c8b3166d)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:19.541853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8120f-7768-4026-8906-18f50e0ec2ed None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:19.543682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 94/177] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:19 2022] GET /identity/v3/projects/a39b655766a7452fb965cbe4c8b3166d => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:19.549708 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8120f-7768-4026-8906-18f50e0ec2ed None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:19.642922 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:19.663288 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:19.671005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d7b1f-e0d3-41b6-97af-532e2058e7a2 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:19.714438 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1761-5901-4a9d-85d9-919e97c61447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:19.715362 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1761-5901-4a9d-85d9-919e97c61447 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:19.716671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1761-5901-4a9d-85d9-919e97c61447 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:19.717101 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1761-5901-4a9d-85d9-919e97c61447 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:19.718537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1761-5901-4a9d-85d9-919e97c61447 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:19.720139 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1761-5901-4a9d-85d9-919e97c61447 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:19.726893 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 84/178] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:19 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:19.729526 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc02f9-991f-4464-8cb6-1f3ac5d1d21e None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:19.729984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc02f9-991f-4464-8cb6-1f3ac5d1d21e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:19.730403 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc02f9-991f-4464-8cb6-1f3ac5d1d21e None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:19.732522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 85/179] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:19.733579 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc02f9-991f-4464-8cb6-1f3ac5d1d21e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:19.800345 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8120f-7768-4026-8906-18f50e0ec2ed None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:19.863494 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc02f9-991f-4464-8cb6-1f3ac5d1d21e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:19.865924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ffe96-8935-4aa6-a44d-0c0fd5cd8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:19.866543 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffe96-8935-4aa6-a44d-0c0fd5cd8392 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:19.867598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffe96-8935-4aa6-a44d-0c0fd5cd8392 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:19.867598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ffe96-8935-4aa6-a44d-0c0fd5cd8392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:19.867988 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ffe96-8935-4aa6-a44d-0c0fd5cd8392 None admin] RBAC: Adding query filter params (role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=a39b655766a7452fb965cbe4c8b3166d, user.id=988d7b945dab46e599712b0e1891d3e7) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:19.868760 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ffe96-8935-4aa6-a44d-0c0fd5cd8392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:19.870326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ffe96-8935-4aa6-a44d-0c0fd5cd8392 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:19.887141 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 95/180] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:19 2022] GET /identity/v3/role_assignments?user.id=988d7b945dab46e599712b0e1891d3e7&scope.project.id=a39b655766a7452fb965cbe4c8b3166d&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 608 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:19.888442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305625-8a46-4431-8f34-7a1f048fe0a1 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:19.888725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305625-8a46-4431-8f34-7a1f048fe0a1 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:19.889050 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305625-8a46-4431-8f34-7a1f048fe0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:19.906689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb077bc-090f-4699-b43e-4a4db0b901a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:19.907669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb077bc-090f-4699-b43e-4a4db0b901a0 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:19.908178 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb077bc-090f-4699-b43e-4a4db0b901a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:19.908647 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb077bc-090f-4699-b43e-4a4db0b901a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:19.909626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb077bc-090f-4699-b43e-4a4db0b901a0 None admin] RBAC: Adding query filter params (role.id=0e16d3dcd8e045fe89150feef6d93543, scope.project.id=4604492596b94e1c8672d5c858d714f1, user.id=988d7b945dab46e599712b0e1891d3e7) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:19.910144 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb077bc-090f-4699-b43e-4a4db0b901a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:19.913247 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb077bc-090f-4699-b43e-4a4db0b901a0 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:19.921225 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 86/181] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:19 2022] GET /identity/v3/role_assignments?user.id=988d7b945dab46e599712b0e1891d3e7&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=0e16d3dcd8e045fe89150feef6d93543 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:19.938820 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-05305625-8a46-4431-8f34-7a1f048fe0a1 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:19.940038 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-05305625-8a46-4431-8f34-7a1f048fe0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:20.033030 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 96/182] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:20.333282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb49bc-7161-4499-9cce-665259110db8 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:20.333855 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb49bc-7161-4499-9cce-665259110db8 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:20.334284 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb49bc-7161-4499-9cce-665259110db8 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:20.335768 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 87/183] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:20.341774 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2352f-24c0-4030-89dd-318c7b92f44c None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:20.342164 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2352f-24c0-4030-89dd-318c7b92f44c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:20.342450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2352f-24c0-4030-89dd-318c7b92f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:20.365543 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-69f2352f-24c0-4030-89dd-318c7b92f44c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:20.366738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-69f2352f-24c0-4030-89dd-318c7b92f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:20.413155 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:20.422428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0eec3-b380-446a-93e5-df862629f937 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:20.422981 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0eec3-b380-446a-93e5-df862629f937 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:20.423474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0eec3-b380-446a-93e5-df862629f937 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:20.425102 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 88/184] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:48:20.430126 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6873b-b0e2-4ec7-8c40-a167b62fa4d3 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:20.437049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6873b-b0e2-4ec7-8c40-a167b62fa4d3 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:20.437049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6873b-b0e2-4ec7-8c40-a167b62fa4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:20.452471 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 97/185] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:20.460285 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-b2f6873b-b0e2-4ec7-8c40-a167b62fa4d3 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:20.461720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-b2f6873b-b0e2-4ec7-8c40-a167b62fa4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:20.463981 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:20.534524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2352f-24c0-4030-89dd-318c7b92f44c None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:20.552920 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 89/186] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:20.662802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2352f-24c0-4030-89dd-318c7b92f44c None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:20.698885 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a11fc-c016-4b96-8672-dcfc281165d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:20.699523 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a11fc-c016-4b96-8672-dcfc281165d3 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:20.699804 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a11fc-c016-4b96-8672-dcfc281165d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:20.700077 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a11fc-c016-4b96-8672-dcfc281165d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:20.710623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a11fc-c016-4b96-8672-dcfc281165d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-427a11fc-c016-4b96-8672-dcfc281165d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:20.715430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:20.716336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:20.717127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 98/187] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:20.722565 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6873b-b0e2-4ec7-8c40-a167b62fa4d3 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:20.814970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a11fc-c016-4b96-8672-dcfc281165d3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:20.829434 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6873b-b0e2-4ec7-8c40-a167b62fa4d3 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:20.856223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:20.872072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:20.872864 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:20.873148 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:20.873438 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:20.874199 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:20.874509 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:20.875926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:20.881523 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:20.885692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 90/188] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:20.891715 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:20.939314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a11fc-c016-4b96-8672-dcfc281165d3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:20.985996 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502f91-4ba6-499b-a073-7ae78f6ef942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:20.986734 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502f91-4ba6-499b-a073-7ae78f6ef942 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:20.987088 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502f91-4ba6-499b-a073-7ae78f6ef942 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:20.987437 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502f91-4ba6-499b-a073-7ae78f6ef942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:20.998369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72502f91-4ba6-499b-a073-7ae78f6ef942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-72502f91-4ba6-499b-a073-7ae78f6ef942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:21.003134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:21.004097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:21.004886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 99/189] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:21.005565 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502f91-4ba6-499b-a073-7ae78f6ef942 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:21.015436 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd448a9-72cd-458e-b666-b2446e07542b None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.052863 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440012-3cdd-44f7-9dd3-571f2ebe0c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.053533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440012-3cdd-44f7-9dd3-571f2ebe0c5c None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.053818 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440012-3cdd-44f7-9dd3-571f2ebe0c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.054091 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440012-3cdd-44f7-9dd3-571f2ebe0c5c None admin] PATH_INFO: `/v3/users/eb598beed4a14b9593df312b01816d9f` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.069376 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54440012-3cdd-44f7-9dd3-571f2ebe0c5c None admin] RBAC: Authorizing `identity:get_user(user_id=eb598beed4a14b9593df312b01816d9f)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.070879 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54440012-3cdd-44f7-9dd3-571f2ebe0c5c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.078206 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 91/190] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:20 2022] GET /identity/v3/users/eb598beed4a14b9593df312b01816d9f => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:21.079023 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440012-3cdd-44f7-9dd3-571f2ebe0c5c None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:21.098291 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:21.108351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502f91-4ba6-499b-a073-7ae78f6ef942 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.139950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:21.145290 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a6c02-b6d7-4c91-829c-ff7e06148d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.146097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a6c02-b6d7-4c91-829c-ff7e06148d3d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.146379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a6c02-b6d7-4c91-829c-ff7e06148d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.146648 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a6c02-b6d7-4c91-829c-ff7e06148d3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.148016 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a6c02-b6d7-4c91-829c-ff7e06148d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.149371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a6c02-b6d7-4c91-829c-ff7e06148d3d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.151935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 100/191] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:21.154714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a6c02-b6d7-4c91-829c-ff7e06148d3d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:21.190146 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440012-3cdd-44f7-9dd3-571f2ebe0c5c None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.228638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.229377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.229572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.229841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.230502 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:21.230798 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.232592 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.244978 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 92/192] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:21.244978 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:21.269326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a6c02-b6d7-4c91-829c-ff7e06148d3d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.306640 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54a393-93af-4dd4-ab14-c8252694404e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.307254 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a393-93af-4dd4-ab14-c8252694404e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.307534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a393-93af-4dd4-ab14-c8252694404e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.307811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a393-93af-4dd4-ab14-c8252694404e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.335074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:21.346040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279689e9-13a1-4a9d-a265-7c8ab0b4e7c2 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.365973 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:21.376646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a393-93af-4dd4-ab14-c8252694404e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.378135 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a393-93af-4dd4-ab14-c8252694404e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.380007 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951bded-87ca-4156-bae8-a57411f9a864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.380623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951bded-87ca-4156-bae8-a57411f9a864 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.380899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951bded-87ca-4156-bae8-a57411f9a864 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.381173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951bded-87ca-4156-bae8-a57411f9a864 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.381839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951bded-87ca-4156-bae8-a57411f9a864 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.383264 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951bded-87ca-4156-bae8-a57411f9a864 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.470963 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 93/193] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:48:21 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:48:21.471736 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951bded-87ca-4156-bae8-a57411f9a864 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:21.479219 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 101/194] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:21.480566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482a6a-f93d-42fd-aef6-d0cd5433705d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.480859 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482a6a-f93d-42fd-aef6-d0cd5433705d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.481139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf482a6a-f93d-42fd-aef6-d0cd5433705d None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.484542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 102/195] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:21.489873 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b65d9d-36a5-4693-a4ac-311c6ff7dac5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.490347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b65d9d-36a5-4693-a4ac-311c6ff7dac5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.490770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b65d9d-36a5-4693-a4ac-311c6ff7dac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.510968 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-84b65d9d-36a5-4693-a4ac-311c6ff7dac5 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:21.512484 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-84b65d9d-36a5-4693-a4ac-311c6ff7dac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:21.576862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:21.589649 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 103/196] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:21.590445 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b65d9d-36a5-4693-a4ac-311c6ff7dac5 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:21.615135 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951bded-87ca-4156-bae8-a57411f9a864 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.656297 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5375a27-c722-460a-a69e-d8e0ea7d978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.657528 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375a27-c722-460a-a69e-d8e0ea7d978a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.658028 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375a27-c722-460a-a69e-d8e0ea7d978a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.658374 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375a27-c722-460a-a69e-d8e0ea7d978a None admin] PATH_INFO: `/v3/users/eb598beed4a14b9593df312b01816d9f` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.659638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5375a27-c722-460a-a69e-d8e0ea7d978a None admin] RBAC: Authorizing `identity:get_user(user_id=eb598beed4a14b9593df312b01816d9f)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.661350 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5375a27-c722-460a-a69e-d8e0ea7d978a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.662975 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 94/197] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:21 2022] GET /identity/v3/users/eb598beed4a14b9593df312b01816d9f => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:21.669647 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5375a27-c722-460a-a69e-d8e0ea7d978a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:21.710557 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b65d9d-36a5-4693-a4ac-311c6ff7dac5 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.732996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:21.757072 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2245ac-1426-4e81-adb8-5da9878eae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.758657 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2245ac-1426-4e81-adb8-5da9878eae69 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.758657 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2245ac-1426-4e81-adb8-5da9878eae69 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.758657 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2245ac-1426-4e81-adb8-5da9878eae69 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.760694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2245ac-1426-4e81-adb8-5da9878eae69 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.762325 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2245ac-1426-4e81-adb8-5da9878eae69 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.764153 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 104/198] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:21 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:21.770167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2245ac-1426-4e81-adb8-5da9878eae69 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:21.800147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5375a27-c722-460a-a69e-d8e0ea7d978a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.840932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838ea0-1929-4bbf-a7d0-49aa1bbc364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.841584 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838ea0-1929-4bbf-a7d0-49aa1bbc364e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.841864 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838ea0-1929-4bbf-a7d0-49aa1bbc364e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.842134 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90838ea0-1929-4bbf-a7d0-49aa1bbc364e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.847573 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:21.903363 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2245ac-1426-4e81-adb8-5da9878eae69 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:21.925140 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90838ea0-1929-4bbf-a7d0-49aa1bbc364e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.927033 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90838ea0-1929-4bbf-a7d0-49aa1bbc364e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.943771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:21.944381 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:21.944655 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:21.944922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:21.945797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] RBAC: Adding query filter params (role.id=0e16d3dcd8e045fe89150feef6d93543, scope.project.id=a92fe046f9574126b7da24bbab315fac, user.id=eb598beed4a14b9593df312b01816d9f) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:21.945971 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:21.948304 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:21.954152 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 105/199] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:21 2022] GET /identity/v3/role_assignments?user.id=eb598beed4a14b9593df312b01816d9f&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=0e16d3dcd8e045fe89150feef6d93543 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:21.954964 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:22.067532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:22.137826 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa234-fbf6-404d-8767-36ce8812c6a9 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:22.176140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:22.186982 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 95/200] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:22.193097 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57404df-1505-43ff-a2ef-b2737f86359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:22.193831 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57404df-1505-43ff-a2ef-b2737f86359d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:22.194108 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57404df-1505-43ff-a2ef-b2737f86359d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:22.194382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57404df-1505-43ff-a2ef-b2737f86359d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:22.194702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838ea0-1929-4bbf-a7d0-49aa1bbc364e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:22.210795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57404df-1505-43ff-a2ef-b2737f86359d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-d57404df-1505-43ff-a2ef-b2737f86359d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:22.216755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:22.217684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:22.218499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:22.226678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 106/201] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:22.233258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57404df-1505-43ff-a2ef-b2737f86359d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:22.347257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90838ea0-1929-4bbf-a7d0-49aa1bbc364e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:22.422442 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb8e84-c9e0-4aca-bd81-6592f3c62561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:22.423098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb8e84-c9e0-4aca-bd81-6592f3c62561 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:22.423389 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb8e84-c9e0-4aca-bd81-6592f3c62561 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:22.423655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb8e84-c9e0-4aca-bd81-6592f3c62561 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:22.430245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb8e84-c9e0-4aca-bd81-6592f3c62561 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:22.432400 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb8e84-c9e0-4aca-bd81-6592f3c62561 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:22.434280 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 96/202] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:22 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:22.434696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57404df-1505-43ff-a2ef-b2737f86359d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:22.442589 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb8e84-c9e0-4aca-bd81-6592f3c62561 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:22.476743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:22.478075 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:22.478678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:22.479155 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:22.480017 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:22.480590 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:22.482760 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:22.494055 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:22.495760 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 107/203] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:22.504570 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:22.588313 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:22.658512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb8e84-c9e0-4aca-bd81-6592f3c62561 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:22.689606 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf03f03-1e59-4b66-b4ae-8e28706710f6 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:22.728819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:22.729448 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:22.729727 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:22.730001 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:22.730723 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=a92fe046f9574126b7da24bbab315fac, user.id=eb598beed4a14b9593df312b01816d9f) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:22.731032 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:22.732548 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:22.745764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 97/204] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:22 2022] GET /identity/v3/role_assignments?user.id=eb598beed4a14b9593df312b01816d9f&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=757702b4209942a3b2ec7bf21d995169 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:22.750617 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1092f-efc1-495e-b218-133cdf4bac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:22.751350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1092f-efc1-495e-b218-133cdf4bac65 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:22.751697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1092f-efc1-495e-b218-133cdf4bac65 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:22.752085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1092f-efc1-495e-b218-133cdf4bac65 None admin] PATH_INFO: `/v3/users/c2319bfaa3e8439fa0a68ecfb8ef7552` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:22.753395 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1092f-efc1-495e-b218-133cdf4bac65 None admin] RBAC: Authorizing `identity:get_user(user_id=c2319bfaa3e8439fa0a68ecfb8ef7552)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:22.755032 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1092f-efc1-495e-b218-133cdf4bac65 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:22.761528 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 108/205] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:22 2022] GET /identity/v3/users/c2319bfaa3e8439fa0a68ecfb8ef7552 => generated 289 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:22.762997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:22.895876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:22.936076 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a09f-d383-4b09-8350-7cba11e5ee24 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:22.975510 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804387-c55e-4ffa-987f-96bee5ac527e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:22.976290 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804387-c55e-4ffa-987f-96bee5ac527e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:22.976575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804387-c55e-4ffa-987f-96bee5ac527e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:22.976846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804387-c55e-4ffa-987f-96bee5ac527e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:23.057911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804387-c55e-4ffa-987f-96bee5ac527e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:23.059404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804387-c55e-4ffa-987f-96bee5ac527e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:23.162290 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:23.192058 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 98/206] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:23.193378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1092f-efc1-495e-b218-133cdf4bac65 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:23.314539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1092f-efc1-495e-b218-133cdf4bac65 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:23.335430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:23.361797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb2094-3476-4081-aa91-44f98a6f750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:23.362440 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2094-3476-4081-aa91-44f98a6f750c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:23.362721 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2094-3476-4081-aa91-44f98a6f750c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:23.362999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb2094-3476-4081-aa91-44f98a6f750c None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:23.364134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb2094-3476-4081-aa91-44f98a6f750c None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:23.365630 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb2094-3476-4081-aa91-44f98a6f750c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:23.367481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 109/207] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:23 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:23.373654 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804387-c55e-4ffa-987f-96bee5ac527e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:23.513199 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804387-c55e-4ffa-987f-96bee5ac527e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:23.563496 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca08d4-016c-41dd-a1c9-9496956468df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:23.564101 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca08d4-016c-41dd-a1c9-9496956468df None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:23.564377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca08d4-016c-41dd-a1c9-9496956468df None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:23.564645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca08d4-016c-41dd-a1c9-9496956468df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:23.565440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca08d4-016c-41dd-a1c9-9496956468df None admin] RBAC: Adding query filter params (role.id=0c2da9b50ef4450c98676939632e93b6, scope.project.id=4604492596b94e1c8672d5c858d714f1, user.id=c2319bfaa3e8439fa0a68ecfb8ef7552) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:23.565757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca08d4-016c-41dd-a1c9-9496956468df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:23.567256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca08d4-016c-41dd-a1c9-9496956468df None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:23.574042 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 99/208] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:23 2022] GET /identity/v3/role_assignments?user.id=c2319bfaa3e8439fa0a68ecfb8ef7552&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=0c2da9b50ef4450c98676939632e93b6 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:24.371568 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def1d4-8297-4ef2-af60-964f4447bade None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:24.372580 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def1d4-8297-4ef2-af60-964f4447bade None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:24.373061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34def1d4-8297-4ef2-af60-964f4447bade None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:24.374709 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 110/209] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:24.380175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bfd5e-97bf-4335-83a1-a0c02d78665b None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:24.380948 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bfd5e-97bf-4335-83a1-a0c02d78665b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:24.381447 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bfd5e-97bf-4335-83a1-a0c02d78665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:24.400741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-f48bfd5e-97bf-4335-83a1-a0c02d78665b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:24.402438 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-f48bfd5e-97bf-4335-83a1-a0c02d78665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:24.411321 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb401a31-17b5-4e25-913f-6be59eb8e867 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:24.411936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb401a31-17b5-4e25-913f-6be59eb8e867 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:24.412404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb401a31-17b5-4e25-913f-6be59eb8e867 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:24.414382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 111/210] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:48:24.422304 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d879-bbf5-4733-ab6b-5c1a7761b6cb None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:24.422612 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d879-bbf5-4733-ab6b-5c1a7761b6cb None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:24.422865 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653d879-bbf5-4733-ab6b-5c1a7761b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:24.441682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-a653d879-bbf5-4733-ab6b-5c1a7761b6cb None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:24.442902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-a653d879-bbf5-4733-ab6b-5c1a7761b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:24.450350 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:24.513754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 100/211] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:24.529853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 112/212] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:24.585476 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6f0b1-99b9-49b6-a9f5-22edb48c79c2 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:24.585783 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6f0b1-99b9-49b6-a9f5-22edb48c79c2 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:24.586039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6f0b1-99b9-49b6-a9f5-22edb48c79c2 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:24.587945 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 101/213] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:24.593156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5d6f-6c37-4cb6-8b25-80802980aeca None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:24.593687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5d6f-6c37-4cb6-8b25-80802980aeca None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:24.594165 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5d6f-6c37-4cb6-8b25-80802980aeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:24.613634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c1be5d6f-6c37-4cb6-8b25-80802980aeca None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:24.615103 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c1be5d6f-6c37-4cb6-8b25-80802980aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:24.688725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 113/214] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:24.870508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6f0b1-99b9-49b6-a9f5-22edb48c79c2 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:24.871847 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be5d6f-6c37-4cb6-8b25-80802980aeca None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:24.917509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:24.977991 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be5d6f-6c37-4cb6-8b25-80802980aeca None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:24.980362 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6f0b1-99b9-49b6-a9f5-22edb48c79c2 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:25.016239 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4b50-d65d-4fa4-997a-0aca2c90f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.016965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebc1c7-b7c4-4204-98c5-0a5d7928c358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.017516 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4b50-d65d-4fa4-997a-0aca2c90f380 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.017624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc1c7-b7c4-4204-98c5-0a5d7928c358 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.017891 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc1c7-b7c4-4204-98c5-0a5d7928c358 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.018160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebc1c7-b7c4-4204-98c5-0a5d7928c358 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.018489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4b50-d65d-4fa4-997a-0aca2c90f380 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.018969 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c4b50-d65d-4fa4-997a-0aca2c90f380 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.019273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebc1c7-b7c4-4204-98c5-0a5d7928c358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:25.020722 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebc1c7-b7c4-4204-98c5-0a5d7928c358 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:25.027747 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 102/215] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:25.029138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebc1c7-b7c4-4204-98c5-0a5d7928c358 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:25.032040 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c4b50-d65d-4fa4-997a-0aca2c90f380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-532c4b50-d65d-4fa4-997a-0aca2c90f380 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:25.037058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:25.037970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:25.038781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:25.041512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 114/216] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:25.042766 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4b50-d65d-4fa4-997a-0aca2c90f380 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:25.069823 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:25.147399 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebc1c7-b7c4-4204-98c5-0a5d7928c358 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:25.151762 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:25.155022 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c4b50-d65d-4fa4-997a-0aca2c90f380 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:25.190898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b801e8-cb4f-4e7d-a919-bed56ad700ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.191349 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88064018-0548-4a86-a650-4d0664e6d210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.191566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b801e8-cb4f-4e7d-a919-bed56ad700ab None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.191793 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b801e8-cb4f-4e7d-a919-bed56ad700ab None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.191953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88064018-0548-4a86-a650-4d0664e6d210 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.192045 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b801e8-cb4f-4e7d-a919-bed56ad700ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.192233 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88064018-0548-4a86-a650-4d0664e6d210 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.192506 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88064018-0548-4a86-a650-4d0664e6d210 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.193153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88064018-0548-4a86-a650-4d0664e6d210 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:25.194620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88064018-0548-4a86-a650-4d0664e6d210 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:25.203989 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b801e8-cb4f-4e7d-a919-bed56ad700ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-b7b801e8-cb4f-4e7d-a919-bed56ad700ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:25.208795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:25.209911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 115/217] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:25.214387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b801e8-cb4f-4e7d-a919-bed56ad700ab None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:25.310772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b801e8-cb4f-4e7d-a919-bed56ad700ab None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:25.316955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 103/218] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:48:25 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:48:25.317704 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88064018-0548-4a86-a650-4d0664e6d210 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:25.347487 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922b6dd-42f1-4691-8089-2c4f559bae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.348120 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b6dd-42f1-4691-8089-2c4f559bae6c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.348444 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b6dd-42f1-4691-8089-2c4f559bae6c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.348694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b6dd-42f1-4691-8089-2c4f559bae6c None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.349384 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b6dd-42f1-4691-8089-2c4f559bae6c None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:25.349722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b6dd-42f1-4691-8089-2c4f559bae6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:25.351194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b6dd-42f1-4691-8089-2c4f559bae6c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:25.360501 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 116/219] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:25.361832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aa6b7-5432-4f35-9307-143dff62ec43 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.362121 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aa6b7-5432-4f35-9307-143dff62ec43 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.362396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373aa6b7-5432-4f35-9307-143dff62ec43 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.363822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 117/220] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:25.369107 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aa6b7-5432-4f35-9307-143dff62ec43 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:25.398669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:25.443056 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:25.452895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88064018-0548-4a86-a650-4d0664e6d210 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:25.497063 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373aa6b7-5432-4f35-9307-143dff62ec43 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:25.505286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9a9b1-d565-416f-ba2f-ac5c604822fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.505947 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a9b1-d565-416f-ba2f-ac5c604822fa None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.506224 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a9b1-d565-416f-ba2f-ac5c604822fa None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.506527 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9a9b1-d565-416f-ba2f-ac5c604822fa None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.507195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a9b1-d565-416f-ba2f-ac5c604822fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:25.507499 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a9b1-d565-416f-ba2f-ac5c604822fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:25.509747 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9a9b1-d565-416f-ba2f-ac5c604822fa None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:25.519888 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 104/221] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:25.521187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f09d-622c-4da9-850e-93768c4405f7 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.521509 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f09d-622c-4da9-850e-93768c4405f7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.521783 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f09d-622c-4da9-850e-93768c4405f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.538268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5672-0bc1-46e6-ab6b-b46877648eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.538898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5672-0bc1-46e6-ab6b-b46877648eb3 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.539174 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5672-0bc1-46e6-ab6b-b46877648eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.539449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d5672-0bc1-46e6-ab6b-b46877648eb3 None admin] PATH_INFO: `/v3/users/59c709936c0a43e0a5b50503564de521` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.543212 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d694f09d-622c-4da9-850e-93768c4405f7 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:25.544408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d694f09d-622c-4da9-850e-93768c4405f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:25.556544 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5672-0bc1-46e6-ab6b-b46877648eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=59c709936c0a43e0a5b50503564de521)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:25.558088 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d5672-0bc1-46e6-ab6b-b46877648eb3 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:25.559774 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 118/222] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:25 2022] GET /identity/v3/users/59c709936c0a43e0a5b50503564de521 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:25.560629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5672-0bc1-46e6-ab6b-b46877648eb3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:25.624709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 105/223] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:25.625236 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694f09d-622c-4da9-850e-93768c4405f7 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:25.684260 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:25.704382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d5672-0bc1-46e6-ab6b-b46877648eb3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:25.731934 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:25.751009 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cbdbe-74f6-4421-ae40-a543bf4182f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.751654 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cbdbe-74f6-4421-ae40-a543bf4182f4 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.751931 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cbdbe-74f6-4421-ae40-a543bf4182f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.752206 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cbdbe-74f6-4421-ae40-a543bf4182f4 None admin] PATH_INFO: `/v3/users/eb598beed4a14b9593df312b01816d9f` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.753759 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cbdbe-74f6-4421-ae40-a543bf4182f4 None admin] RBAC: Authorizing `identity:get_user(user_id=eb598beed4a14b9593df312b01816d9f)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:25.755215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cbdbe-74f6-4421-ae40-a543bf4182f4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:25.756976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 119/224] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:25 2022] GET /identity/v3/users/eb598beed4a14b9593df312b01816d9f => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:25.761063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694f09d-622c-4da9-850e-93768c4405f7 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:25.763522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cbdbe-74f6-4421-ae40-a543bf4182f4 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:25.825373 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97048c4b-5d9d-4634-b485-5aebcb484d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:25.826154 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048c4b-5d9d-4634-b485-5aebcb484d08 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:25.826436 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048c4b-5d9d-4634-b485-5aebcb484d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:25.826710 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048c4b-5d9d-4634-b485-5aebcb484d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:25.959131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cbdbe-74f6-4421-ae40-a543bf4182f4 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:26.016248 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97048c4b-5d9d-4634-b485-5aebcb484d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:26.017200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56206-251b-4dcf-b71f-ee1936c74745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:26.017884 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56206-251b-4dcf-b71f-ee1936c74745 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:26.018171 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56206-251b-4dcf-b71f-ee1936c74745 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:26.018271 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97048c4b-5d9d-4634-b485-5aebcb484d08 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:26.018981 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56206-251b-4dcf-b71f-ee1936c74745 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:26.019824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb56206-251b-4dcf-b71f-ee1936c74745 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:26.023420 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb56206-251b-4dcf-b71f-ee1936c74745 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:26.023420 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 120/225] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:25 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:26.037461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56206-251b-4dcf-b71f-ee1936c74745 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:26.060776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:26.197122 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:26.211096 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 106/226] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:26.212955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97048c4b-5d9d-4634-b485-5aebcb484d08 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:26.244723 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56206-251b-4dcf-b71f-ee1936c74745 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:26.324837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d65d-4299-4ec9-8eda-e4b940e97d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:26.325683 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d65d-4299-4ec9-8eda-e4b940e97d6c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:26.325796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d65d-4299-4ec9-8eda-e4b940e97d6c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:26.326048 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434d65d-4299-4ec9-8eda-e4b940e97d6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:26.336215 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97048c4b-5d9d-4634-b485-5aebcb484d08 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:26.338581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434d65d-4299-4ec9-8eda-e4b940e97d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-4434d65d-4299-4ec9-8eda-e4b940e97d6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:26.343303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:26.344195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:26.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 121/227] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:26.350750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d65d-4299-4ec9-8eda-e4b940e97d6c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:26.395779 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90b833-22e1-4b3b-96e1-679dd4c39b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:26.396458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b833-22e1-4b3b-96e1-679dd4c39b8c None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:26.396736 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b833-22e1-4b3b-96e1-679dd4c39b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:26.397009 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90b833-22e1-4b3b-96e1-679dd4c39b8c None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac/users/eb598beed4a14b9593df312b01816d9f/roles/0e16d3dcd8e045fe89150feef6d93543` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:26.401830 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90b833-22e1-4b3b-96e1-679dd4c39b8c None admin] RBAC: Authorizing `identity:create_grant(project_id=a92fe046f9574126b7da24bbab315fac, user_id=eb598beed4a14b9593df312b01816d9f, role_id=0e16d3dcd8e045fe89150feef6d93543)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:26.404003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90b833-22e1-4b3b-96e1-679dd4c39b8c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:26.470750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:26.478824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 107/228] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:26 2022] PUT /identity/v3/projects/a92fe046f9574126b7da24bbab315fac/users/eb598beed4a14b9593df312b01816d9f/roles/0e16d3dcd8e045fe89150feef6d93543 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:26.479674 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90b833-22e1-4b3b-96e1-679dd4c39b8c None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:26.523061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434d65d-4299-4ec9-8eda-e4b940e97d6c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:26.580251 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:26.626553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9655973-4ad1-4515-a697-ccc9d5d65660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:26.627212 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655973-4ad1-4515-a697-ccc9d5d65660 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:26.627493 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655973-4ad1-4515-a697-ccc9d5d65660 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:26.627768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9655973-4ad1-4515-a697-ccc9d5d65660 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:26.628935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9655973-4ad1-4515-a697-ccc9d5d65660 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:26.630481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9655973-4ad1-4515-a697-ccc9d5d65660 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:26.632191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 122/229] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:26 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:26.650984 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9655973-4ad1-4515-a697-ccc9d5d65660 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:26.653115 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90b833-22e1-4b3b-96e1-679dd4c39b8c None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:26.698575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:26.698778 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:26.698999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:26.699190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:26.699918 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:26.700221 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:26.701745 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:26.713324 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 108/230] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:26.719828 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:26.808026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9655973-4ad1-4515-a697-ccc9d5d65660 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:26.870688 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:26.871661 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:26.871947 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:26.872229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:26.872967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] RBAC: Adding query filter params (role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=a92fe046f9574126b7da24bbab315fac, user.id=59c709936c0a43e0a5b50503564de521) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:26.873279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:26.874836 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:26.886561 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba009b1-16b5-4fc0-96d3-47abc3809d4d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:26.888449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 123/231] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:26 2022] GET /identity/v3/role_assignments?user.id=59c709936c0a43e0a5b50503564de521&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:26.897315 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:26.925004 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c16ce-dfe6-4dee-9935-e974511271f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:26.926033 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c16ce-dfe6-4dee-9935-e974511271f7 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:26.926518 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c16ce-dfe6-4dee-9935-e974511271f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:26.926991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c16ce-dfe6-4dee-9935-e974511271f7 None admin] PATH_INFO: `/v3/users/eb598beed4a14b9593df312b01816d9f` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:26.929296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c16ce-dfe6-4dee-9935-e974511271f7 None admin] RBAC: Authorizing `identity:get_user(user_id=eb598beed4a14b9593df312b01816d9f)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:26.931609 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c16ce-dfe6-4dee-9935-e974511271f7 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:26.934307 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 109/232] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:26 2022] GET /identity/v3/users/eb598beed4a14b9593df312b01816d9f => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:26.942839 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:26.962849 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:27.109086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ea54-b4d0-4529-9dc4-af6620a155ec None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:27.156326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e314d5-3692-4f2b-a342-7ce443506f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:27.157023 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e314d5-3692-4f2b-a342-7ce443506f99 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:27.157306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e314d5-3692-4f2b-a342-7ce443506f99 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:27.157718 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e314d5-3692-4f2b-a342-7ce443506f99 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:27.159311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e314d5-3692-4f2b-a342-7ce443506f99 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:27.161031 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e314d5-3692-4f2b-a342-7ce443506f99 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:27.162875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 124/233] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:26 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:27.169686 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c16ce-dfe6-4dee-9935-e974511271f7 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:27.287208 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c16ce-dfe6-4dee-9935-e974511271f7 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:27.323040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08eeb-57f6-4c6c-acbd-dc05544fbbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:27.323711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08eeb-57f6-4c6c-acbd-dc05544fbbaf None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:27.324011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08eeb-57f6-4c6c-acbd-dc05544fbbaf None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:27.324274 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08eeb-57f6-4c6c-acbd-dc05544fbbaf None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac/users/eb598beed4a14b9593df312b01816d9f/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:27.326381 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f08eeb-57f6-4c6c-acbd-dc05544fbbaf None admin] RBAC: Authorizing `identity:create_grant(project_id=a92fe046f9574126b7da24bbab315fac, user_id=eb598beed4a14b9593df312b01816d9f, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:27.327847 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f08eeb-57f6-4c6c-acbd-dc05544fbbaf None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:27.435922 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 110/234] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:27 2022] PUT /identity/v3/projects/a92fe046f9574126b7da24bbab315fac/users/eb598beed4a14b9593df312b01816d9f/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:27.854713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726f3b-4b15-40e5-a5e2-a383a682235a None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:27.855479 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726f3b-4b15-40e5-a5e2-a383a682235a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:27.855479 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726f3b-4b15-40e5-a5e2-a383a682235a None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:27.856581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 125/235] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:48:27.863252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b825b-6fda-41e9-b1b3-41d919c3971c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:27.863668 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b825b-6fda-41e9-b1b3-41d919c3971c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:27.863860 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b825b-6fda-41e9-b1b3-41d919c3971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:27.894723 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d02b825b-6fda-41e9-b1b3-41d919c3971c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:27.895909 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d02b825b-6fda-41e9-b1b3-41d919c3971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:27.934620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:27.990997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 111/236] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:28.191540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc753-8da8-4daf-8e4e-4843615edfc2 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:28.192180 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc753-8da8-4daf-8e4e-4843615edfc2 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:28.192699 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc753-8da8-4daf-8e4e-4843615edfc2 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:28.194516 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 126/237] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:28.200537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721709-83df-48da-b10d-5b19e8c8a0fd None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:28.200819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721709-83df-48da-b10d-5b19e8c8a0fd None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:28.201088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721709-83df-48da-b10d-5b19e8c8a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:28.226435 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-80721709-83df-48da-b10d-5b19e8c8a0fd None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:28.228319 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-80721709-83df-48da-b10d-5b19e8c8a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:28.311844 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 112/238] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:28.449965 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dc753-8da8-4daf-8e4e-4843615edfc2 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:28.566456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:28.595984 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dc753-8da8-4daf-8e4e-4843615edfc2 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:28.647228 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79220-b295-4356-86ad-9438f9275760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:28.647864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79220-b295-4356-86ad-9438f9275760 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:28.648142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79220-b295-4356-86ad-9438f9275760 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:28.648414 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce79220-b295-4356-86ad-9438f9275760 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:28.663575 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce79220-b295-4356-86ad-9438f9275760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-3ce79220-b295-4356-86ad-9438f9275760 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:28.668958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:28.669867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:28.670671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 127/239] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:28.675924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80721709-83df-48da-b10d-5b19e8c8a0fd None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:28.729858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79220-b295-4356-86ad-9438f9275760 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:28.874882 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:28.883244 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80721709-83df-48da-b10d-5b19e8c8a0fd None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:28.898539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce79220-b295-4356-86ad-9438f9275760 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:28.947687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197beb0-ddd8-460f-bc72-40e7a3064265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:28.948607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197beb0-ddd8-460f-bc72-40e7a3064265 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:28.949044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197beb0-ddd8-460f-bc72-40e7a3064265 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:28.949488 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197beb0-ddd8-460f-bc72-40e7a3064265 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:28.951022 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197beb0-ddd8-460f-bc72-40e7a3064265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:28.952926 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197beb0-ddd8-460f-bc72-40e7a3064265 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:28.954719 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 128/240] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:28.960382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197beb0-ddd8-460f-bc72-40e7a3064265 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:28.965667 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:28.966934 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:28.970174 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:28.970536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:28.970822 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:28.971601 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:28.972018 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:28.973449 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:28.991812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 113/241] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:28.999990 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:29.104944 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197beb0-ddd8-460f-bc72-40e7a3064265 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:29.145013 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832cb34-4585-4678-9a1f-969983a8da79 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:29.179959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f6f06-f538-4b6d-8d51-911d9ae8ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:29.181345 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6f06-f538-4b6d-8d51-911d9ae8ac21 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:29.181874 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6f06-f538-4b6d-8d51-911d9ae8ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:29.182338 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6f06-f538-4b6d-8d51-911d9ae8ac21 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:29.183189 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f6f06-f538-4b6d-8d51-911d9ae8ac21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:29.184839 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f6f06-f538-4b6d-8d51-911d9ae8ac21 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:29.194594 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802070-91e8-44f3-8765-83fd961ddde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:29.195491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802070-91e8-44f3-8765-83fd961ddde6 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:29.196012 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802070-91e8-44f3-8765-83fd961ddde6 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:29.196480 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca802070-91e8-44f3-8765-83fd961ddde6 None admin] PATH_INFO: `/v3/users/d114912561a948d28706552e1b9b6bc5` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:29.215121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca802070-91e8-44f3-8765-83fd961ddde6 None admin] RBAC: Authorizing `identity:get_user(user_id=d114912561a948d28706552e1b9b6bc5)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:29.217064 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca802070-91e8-44f3-8765-83fd961ddde6 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:29.219029 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 114/242] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:28 2022] GET /identity/v3/users/d114912561a948d28706552e1b9b6bc5 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:29.224708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802070-91e8-44f3-8765-83fd961ddde6 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:29.244775 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:29.275682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 129/243] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:48:28 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:48:29.344986 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca802070-91e8-44f3-8765-83fd961ddde6 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:29.386178 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c081a89-cacf-43aa-b50e-d994ad3ba62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:29.387198 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c081a89-cacf-43aa-b50e-d994ad3ba62d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:29.387681 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c081a89-cacf-43aa-b50e-d994ad3ba62d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:29.388155 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c081a89-cacf-43aa-b50e-d994ad3ba62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:29.466539 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c081a89-cacf-43aa-b50e-d994ad3ba62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:29.468453 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c081a89-cacf-43aa-b50e-d994ad3ba62d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:29.501895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:29.541433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e37ac-4d72-44e4-818c-a7c223ac479e None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:29.541752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e37ac-4d72-44e4-818c-a7c223ac479e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:29.541981 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e37ac-4d72-44e4-818c-a7c223ac479e None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:29.543866 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 130/244] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:48:29.551189 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1760fba-a7d0-4cdd-a720-a7480d10f7cc None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:29.551461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1760fba-a7d0-4cdd-a720-a7480d10f7cc None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:29.551895 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1760fba-a7d0-4cdd-a720-a7480d10f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:29.584277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-a1760fba-a7d0-4cdd-a720-a7480d10f7cc None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:29.585864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-a1760fba-a7d0-4cdd-a720-a7480d10f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:29.588053 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 115/245] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:29.594024 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c081a89-cacf-43aa-b50e-d994ad3ba62d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:29.672537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:29.686380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 131/246] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:29.734786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c081a89-cacf-43aa-b50e-d994ad3ba62d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:29.757951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:29.783673 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500ff35-2d8d-45bb-be82-f0914acfbf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:29.784604 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500ff35-2d8d-45bb-be82-f0914acfbf1f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:29.785287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500ff35-2d8d-45bb-be82-f0914acfbf1f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:29.790087 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500ff35-2d8d-45bb-be82-f0914acfbf1f None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:29.790087 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500ff35-2d8d-45bb-be82-f0914acfbf1f None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:29.790087 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500ff35-2d8d-45bb-be82-f0914acfbf1f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:29.791924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 116/247] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:29 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:29.797863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1760fba-a7d0-4cdd-a720-a7480d10f7cc None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:29.874678 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d946dc0-dbef-4b8a-8812-357e131638e1 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:29.881804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d946dc0-dbef-4b8a-8812-357e131638e1 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:29.881804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d946dc0-dbef-4b8a-8812-357e131638e1 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:29.881804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 117/248] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:29.883222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048daa9-b5ed-4087-a378-ae3f4a829e99 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:29.884362 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048daa9-b5ed-4087-a378-ae3f4a829e99 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:29.884838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048daa9-b5ed-4087-a378-ae3f4a829e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:29.910567 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-0048daa9-b5ed-4087-a378-ae3f4a829e99 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:29.913895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-0048daa9-b5ed-4087-a378-ae3f4a829e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:29.922035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1760fba-a7d0-4cdd-a720-a7480d10f7cc None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:30.073945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:30.074929 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:30.075433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:30.075908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:30.076911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] RBAC: Adding query filter params (role.id=0c2da9b50ef4450c98676939632e93b6, scope.project.id=a92fe046f9574126b7da24bbab315fac, user.id=d114912561a948d28706552e1b9b6bc5) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:30.077582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:30.079553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:30.087212 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 132/249] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:29 2022] GET /identity/v3/role_assignments?user.id=d114912561a948d28706552e1b9b6bc5&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=0c2da9b50ef4450c98676939632e93b6 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:30.088857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:30.149866 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 118/250] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:30.151574 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8638-bb93-483a-93b9-15551f391361 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:30.151858 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8638-bb93-483a-93b9-15551f391361 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:30.152128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c8638-bb93-483a-93b9-15551f391361 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:30.153519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 119/251] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:30.160156 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29db09-2e67-4f92-a4c6-287912cd391b None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:30.160462 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29db09-2e67-4f92-a4c6-287912cd391b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:30.160717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29db09-2e67-4f92-a4c6-287912cd391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:30.183915 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-da29db09-2e67-4f92-a4c6-287912cd391b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:30.185129 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-da29db09-2e67-4f92-a4c6-287912cd391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:30.248735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:30.320339 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 120/252] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:30.341727 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0edd54-fe81-4d49-9624-4fc640eae9bd None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:30.381654 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462ea95-5636-4975-960f-b7ea5e99e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:30.382651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ea95-5636-4975-960f-b7ea5e99e54e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:30.383138 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ea95-5636-4975-960f-b7ea5e99e54e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:30.383640 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462ea95-5636-4975-960f-b7ea5e99e54e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:30.394859 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462ea95-5636-4975-960f-b7ea5e99e54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-a462ea95-5636-4975-960f-b7ea5e99e54e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:30.400442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:30.401369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:30.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:30.404812 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 133/253] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:30.410487 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29db09-2e67-4f92-a4c6-287912cd391b None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:30.461827 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:30.520644 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29db09-2e67-4f92-a4c6-287912cd391b None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:30.559135 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:30.559755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:30.560035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:30.560308 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:30.560977 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:30.561283 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:30.562697 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:30.572160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 121/254] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:30.577740 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462ea95-5636-4975-960f-b7ea5e99e54e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:30.611377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:30.786774 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462ea95-5636-4975-960f-b7ea5e99e54e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:30.821578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8e6ef9-4ab7-4314-a300-995d4e68ed7f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:30.826525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:30.833236 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:30.867850 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97363-ddf0-47fe-aa66-78d8961fd887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:30.868438 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97363-ddf0-47fe-aa66-78d8961fd887 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:30.868721 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97363-ddf0-47fe-aa66-78d8961fd887 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:30.869001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d97363-ddf0-47fe-aa66-78d8961fd887 None admin] PATH_INFO: `/v3/users/eb598beed4a14b9593df312b01816d9f` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:30.874192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d97363-ddf0-47fe-aa66-78d8961fd887 None admin] RBAC: Authorizing `identity:get_user(user_id=eb598beed4a14b9593df312b01816d9f)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:30.875661 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d97363-ddf0-47fe-aa66-78d8961fd887 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:30.877257 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 134/255] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:30 2022] GET /identity/v3/users/eb598beed4a14b9593df312b01816d9f => generated 283 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:30.878326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97363-ddf0-47fe-aa66-78d8961fd887 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:30.895140 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169e54b-744c-403b-a47d-e81743a23119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:30.895803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e54b-744c-403b-a47d-e81743a23119 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:30.896061 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e54b-744c-403b-a47d-e81743a23119 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:30.896331 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e54b-744c-403b-a47d-e81743a23119 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:30.920183 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169e54b-744c-403b-a47d-e81743a23119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-f169e54b-744c-403b-a47d-e81743a23119 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:30.932223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:30.933167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 122/256] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:30.934404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169e54b-744c-403b-a47d-e81743a23119 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:31.061862 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169e54b-744c-403b-a47d-e81743a23119 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:31.065328 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d97363-ddf0-47fe-aa66-78d8961fd887 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:31.096688 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b9bc6-5427-4c1b-acef-993a3a9a8023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:31.097304 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9bc6-5427-4c1b-acef-993a3a9a8023 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:31.097604 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9bc6-5427-4c1b-acef-993a3a9a8023 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:31.097875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b9bc6-5427-4c1b-acef-993a3a9a8023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:31.135149 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fca9d6-0ba8-4ed6-a860-e302d9c7d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:31.135726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca9d6-0ba8-4ed6-a860-e302d9c7d439 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:31.136012 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca9d6-0ba8-4ed6-a860-e302d9c7d439 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:31.136287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca9d6-0ba8-4ed6-a860-e302d9c7d439 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:31.136805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:31.165305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fca9d6-0ba8-4ed6-a860-e302d9c7d439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-93fca9d6-0ba8-4ed6-a860-e302d9c7d439 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:31.170813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:31.171797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:31.172625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:31.174446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b9bc6-5427-4c1b-acef-993a3a9a8023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:31.176138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b9bc6-5427-4c1b-acef-993a3a9a8023 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:31.177877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 135/257] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:31.178822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fca9d6-0ba8-4ed6-a860-e302d9c7d439 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:31.261824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:31.328052 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 123/258] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:31.329234 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b9bc6-5427-4c1b-acef-993a3a9a8023 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:31.376522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fca9d6-0ba8-4ed6-a860-e302d9c7d439 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:31.437862 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:31.438160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:31.439030 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:31.439030 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:31.439196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:31.439864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:31.440165 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:31.441565 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:31.459939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 136/259] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:31.460565 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:31.498028 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b9bc6-5427-4c1b-acef-993a3a9a8023 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:31.529741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:31.530461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:31.530740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:31.531008 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:31.531656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:31.531953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:31.533544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:31.542725 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 124/260] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:31.543537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:31.626995 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c4a3f-30d1-49f0-a830-dfeed29d0530 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:31.629608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:31.667138 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276e1ad-34a5-4b77-a77f-d0953482c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:31.668128 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e1ad-34a5-4b77-a77f-d0953482c349 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:31.668684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e1ad-34a5-4b77-a77f-d0953482c349 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:31.669160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276e1ad-34a5-4b77-a77f-d0953482c349 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:31.670944 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276e1ad-34a5-4b77-a77f-d0953482c349 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:31.672715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276e1ad-34a5-4b77-a77f-d0953482c349 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:31.674786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 137/261] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:31 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:31.677072 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276e1ad-34a5-4b77-a77f-d0953482c349 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:31.786517 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ade85a-f756-42d2-93d3-29b2d35e23b6 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:31.793904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276e1ad-34a5-4b77-a77f-d0953482c349 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:31.815488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:31.830838 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2b50-3cc9-4a30-8d4c-972df6beaf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:31.831824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2b50-3cc9-4a30-8d4c-972df6beaf6d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:31.832269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2b50-3cc9-4a30-8d4c-972df6beaf6d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:31.832706 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2b50-3cc9-4a30-8d4c-972df6beaf6d None admin] PATH_INFO: `/v3/users/eb598beed4a14b9593df312b01816d9f` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:31.836413 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf2b50-3cc9-4a30-8d4c-972df6beaf6d None admin] RBAC: Authorizing `identity:get_user(user_id=eb598beed4a14b9593df312b01816d9f)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:31.836413 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf2b50-3cc9-4a30-8d4c-972df6beaf6d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:31.837593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 138/262] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:31 2022] GET /identity/v3/users/eb598beed4a14b9593df312b01816d9f => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:31.838456 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b38a5-57aa-44cd-80e2-708a091dea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:31.838846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2b50-3cc9-4a30-8d4c-972df6beaf6d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:31.839176 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b38a5-57aa-44cd-80e2-708a091dea0e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:31.839467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b38a5-57aa-44cd-80e2-708a091dea0e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:31.839746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b38a5-57aa-44cd-80e2-708a091dea0e None admin] PATH_INFO: `/v3/users/59c709936c0a43e0a5b50503564de521` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:31.840920 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b38a5-57aa-44cd-80e2-708a091dea0e None admin] RBAC: Authorizing `identity:get_user(user_id=59c709936c0a43e0a5b50503564de521)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:31.842480 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b38a5-57aa-44cd-80e2-708a091dea0e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:31.844294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 125/263] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:31 2022] GET /identity/v3/users/59c709936c0a43e0a5b50503564de521 => generated 297 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:31.845880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b38a5-57aa-44cd-80e2-708a091dea0e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:31.904170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:31.975834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2b50-3cc9-4a30-8d4c-972df6beaf6d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:32.013137 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:32.014092 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.014539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.014977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.015860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] RBAC: Adding query filter params (role.id=0e16d3dcd8e045fe89150feef6d93543, scope.project.id=a92fe046f9574126b7da24bbab315fac, user.id=eb598beed4a14b9593df312b01816d9f) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:32.016336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:32.018137 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:32.025551 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 139/264] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:31 2022] GET /identity/v3/role_assignments?user.id=eb598beed4a14b9593df312b01816d9f&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=0e16d3dcd8e045fe89150feef6d93543 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:32.026602 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:32.100742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b38a5-57aa-44cd-80e2-708a091dea0e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:32.141402 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0c155-b062-4708-9744-67808a60c041 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:32.144659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:32.180942 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630b895-dcc9-439e-bfe2-44425ec30937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:32.181943 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b895-dcc9-439e-bfe2-44425ec30937 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.182406 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b895-dcc9-439e-bfe2-44425ec30937 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.182859 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630b895-dcc9-439e-bfe2-44425ec30937 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.184261 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630b895-dcc9-439e-bfe2-44425ec30937 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:32.185960 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630b895-dcc9-439e-bfe2-44425ec30937 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:32.186283 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae1dd-3c6e-4340-8df4-a6413f12b0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:32.186964 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae1dd-3c6e-4340-8df4-a6413f12b0eb None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.187307 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae1dd-3c6e-4340-8df4-a6413f12b0eb None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.187659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae1dd-3c6e-4340-8df4-a6413f12b0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.188967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 140/265] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:32 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:32.194882 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630b895-dcc9-439e-bfe2-44425ec30937 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:32.321251 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630b895-dcc9-439e-bfe2-44425ec30937 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:32.362685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885f9a6-a355-4cce-8de9-d571f859d1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:32.363367 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885f9a6-a355-4cce-8de9-d571f859d1ab None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.363643 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885f9a6-a355-4cce-8de9-d571f859d1ab None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.363911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885f9a6-a355-4cce-8de9-d571f859d1ab None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac/users/59c709936c0a43e0a5b50503564de521/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.365667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:32.367839 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885f9a6-a355-4cce-8de9-d571f859d1ab None admin] RBAC: Authorizing `identity:create_grant(project_id=a92fe046f9574126b7da24bbab315fac, user_id=59c709936c0a43e0a5b50503564de521, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:32.369427 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885f9a6-a355-4cce-8de9-d571f859d1ab None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:32.382238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdae1dd-3c6e-4340-8df4-a6413f12b0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:32.383776 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdae1dd-3c6e-4340-8df4-a6413f12b0eb None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:32.456160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 141/266] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:32 2022] PUT /identity/v3/projects/a92fe046f9574126b7da24bbab315fac/users/59c709936c0a43e0a5b50503564de521/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:32.521455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 126/267] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:32.528846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885f9a6-a355-4cce-8de9-d571f859d1ab None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:32.577545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:32.663354 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885f9a6-a355-4cce-8de9-d571f859d1ab None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:32.710335 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799befe2-0a7d-49cb-92f5-463580ab1258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:32.710987 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799befe2-0a7d-49cb-92f5-463580ab1258 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.711273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799befe2-0a7d-49cb-92f5-463580ab1258 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.712348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799befe2-0a7d-49cb-92f5-463580ab1258 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.713831 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799befe2-0a7d-49cb-92f5-463580ab1258 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:32.715370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799befe2-0a7d-49cb-92f5-463580ab1258 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:32.717787 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 142/268] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:32 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:32.724238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae1dd-3c6e-4340-8df4-a6413f12b0eb None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:32.741654 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f376-9144-4dcd-9218-18c703610342 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.741995 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f376-9144-4dcd-9218-18c703610342 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.742209 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762f376-9144-4dcd-9218-18c703610342 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.743587 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 143/269] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:48:32.748964 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051c8f4-baba-4760-9d2a-c7656731bb3f None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.749246 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051c8f4-baba-4760-9d2a-c7656731bb3f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.752612 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051c8f4-baba-4760-9d2a-c7656731bb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.769501 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c051c8f4-baba-4760-9d2a-c7656731bb3f None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:32.770689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c051c8f4-baba-4760-9d2a-c7656731bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:32.841733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:32.844252 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 144/270] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:32.851619 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae1dd-3c6e-4340-8df4-a6413f12b0eb None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:32.902417 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f47f-2a49-43a0-8de9-95bf617721bf None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.902855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f47f-2a49-43a0-8de9-95bf617721bf None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.903136 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f47f-2a49-43a0-8de9-95bf617721bf None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.903503 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02e7f-0cea-4fb7-a490-754070d31e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:32.904216 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02e7f-0cea-4fb7-a490-754070d31e66 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.904643 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 145/271] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:32.904747 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02e7f-0cea-4fb7-a490-754070d31e66 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.904830 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02e7f-0cea-4fb7-a490-754070d31e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.905555 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02e7f-0cea-4fb7-a490-754070d31e66 None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=a92fe046f9574126b7da24bbab315fac, user.id=eb598beed4a14b9593df312b01816d9f) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:32.905870 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02e7f-0cea-4fb7-a490-754070d31e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:32.907330 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02e7f-0cea-4fb7-a490-754070d31e66 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:32.910857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5b9b-f8e4-4224-a199-8934b6399e9d None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:32.911512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5b9b-f8e4-4224-a199-8934b6399e9d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:32.911792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5b9b-f8e4-4224-a199-8934b6399e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:32.914651 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 127/272] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:32 2022] GET /identity/v3/role_assignments?user.id=eb598beed4a14b9593df312b01816d9f&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=757702b4209942a3b2ec7bf21d995169 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:32.943054 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-a9ce5b9b-f8e4-4224-a199-8934b6399e9d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:32.944275 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-a9ce5b9b-f8e4-4224-a199-8934b6399e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:32.988164 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:33.038917 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 146/273] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:33.188192 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9189a26-3d86-40b9-b472-ff501920da89 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:33.188670 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9189a26-3d86-40b9-b472-ff501920da89 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:33.188670 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9189a26-3d86-40b9-b472-ff501920da89 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:33.190050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 128/274] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:33.195280 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20097e5-de8e-4310-9ef7-6f0eca6d9a16 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:33.196182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20097e5-de8e-4310-9ef7-6f0eca6d9a16 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:33.196396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20097e5-de8e-4310-9ef7-6f0eca6d9a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:33.216451 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-d20097e5-de8e-4310-9ef7-6f0eca6d9a16 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:33.217660 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-d20097e5-de8e-4310-9ef7-6f0eca6d9a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:33.288989 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 147/275] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:33.323236 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9189a26-3d86-40b9-b472-ff501920da89 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:33.437568 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20097e5-de8e-4310-9ef7-6f0eca6d9a16 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:33.440760 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9189a26-3d86-40b9-b472-ff501920da89 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:33.500704 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff8b0c-2134-4a4c-a719-a86b843d6250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:33.501337 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff8b0c-2134-4a4c-a719-a86b843d6250 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:33.503281 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff8b0c-2134-4a4c-a719-a86b843d6250 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:33.503281 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff8b0c-2134-4a4c-a719-a86b843d6250 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:33.526068 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff8b0c-2134-4a4c-a719-a86b843d6250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-13ff8b0c-2134-4a4c-a719-a86b843d6250 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:33.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:33.533751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:33.534550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:33.537358 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 129/276] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:33.543299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff8b0c-2134-4a4c-a719-a86b843d6250 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:33.566537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:33.581855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:33.592652 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20097e5-de8e-4310-9ef7-6f0eca6d9a16 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:33.630752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191d5b4-2bd5-4031-a913-aac0556ca12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:33.631719 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d5b4-2bd5-4031-a913-aac0556ca12b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:33.632287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d5b4-2bd5-4031-a913-aac0556ca12b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:33.632775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191d5b4-2bd5-4031-a913-aac0556ca12b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:33.635669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191d5b4-2bd5-4031-a913-aac0556ca12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:33.637307 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191d5b4-2bd5-4031-a913-aac0556ca12b None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:33.639186 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 148/277] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:33.644636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191d5b4-2bd5-4031-a913-aac0556ca12b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:33.653322 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff8b0c-2134-4a4c-a719-a86b843d6250 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:33.689704 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:33.690324 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:33.690603 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:33.690923 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:33.691530 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] RBAC: Adding query filter params (name=member) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:33.691833 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:33.693231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:33.702609 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 130/278] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:33.706626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:33.752679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191d5b4-2bd5-4031-a913-aac0556ca12b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:33.789352 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b209d93-05e4-4d1e-9196-d99ee7c97bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:33.790112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b209d93-05e4-4d1e-9196-d99ee7c97bbb None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:33.790396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b209d93-05e4-4d1e-9196-d99ee7c97bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:33.790670 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b209d93-05e4-4d1e-9196-d99ee7c97bbb None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:33.791307 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b209d93-05e4-4d1e-9196-d99ee7c97bbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:33.792878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b209d93-05e4-4d1e-9196-d99ee7c97bbb None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:33.793440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:33.812141 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca9f92-8881-41d1-9dd0-a4159502e65f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:33.848724 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3ae6-cba4-4b10-b09e-7281ca6cf5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:33.849383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3ae6-cba4-4b10-b09e-7281ca6cf5c3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:33.849690 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3ae6-cba4-4b10-b09e-7281ca6cf5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:33.849958 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d3ae6-cba4-4b10-b09e-7281ca6cf5c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:33.860215 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d3ae6-cba4-4b10-b09e-7281ca6cf5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-295d3ae6-cba4-4b10-b09e-7281ca6cf5c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:33.865341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:33.866408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:33.868063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 131/279] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:33.869456 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3ae6-cba4-4b10-b09e-7281ca6cf5c3 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:33.897105 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 149/280] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:48:33 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:48:33.898071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b209d93-05e4-4d1e-9196-d99ee7c97bbb None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:33.928093 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:34.011800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d3ae6-cba4-4b10-b09e-7281ca6cf5c3 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:34.040656 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b209d93-05e4-4d1e-9196-d99ee7c97bbb None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:34.065458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d5691-8924-4b93-9357-3df8f882345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:34.066045 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5691-8924-4b93-9357-3df8f882345e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:34.066326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5691-8924-4b93-9357-3df8f882345e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:34.066600 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d5691-8924-4b93-9357-3df8f882345e None admin] PATH_INFO: `/v3/users/0787b6f4aa954a09b999848c2cf4a5ef` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:34.079765 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:34.083514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d5691-8924-4b93-9357-3df8f882345e None admin] RBAC: Authorizing `identity:get_user(user_id=0787b6f4aa954a09b999848c2cf4a5ef)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:34.084755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d5691-8924-4b93-9357-3df8f882345e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:34.087171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 132/281] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:33 2022] GET /identity/v3/users/0787b6f4aa954a09b999848c2cf4a5ef => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:34.089618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:34.090604 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:34.091136 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:34.091607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:34.092629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:34.093012 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d5691-8924-4b93-9357-3df8f882345e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:34.093155 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:34.094729 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:34.105265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 150/282] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:34.110420 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:34.202849 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:34.209027 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d5691-8924-4b93-9357-3df8f882345e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:34.232567 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4baa586-5447-418b-a22e-53e9d3b12655 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:34.254455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:34.255131 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:34.255411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:34.255737 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:34.256495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] RBAC: Adding query filter params (role.id=6126abc4720c4543854a6fd2ddfacbbf, user.id=0787b6f4aa954a09b999848c2cf4a5ef, scope.system=all) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:34.256934 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:34.258924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:34.265830 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 133/283] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Aug 19 17:48:34 2022] GET /identity/v3/role_assignments?user.id=0787b6f4aa954a09b999848c2cf4a5ef&scope.system=all&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:34.274849 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df8e41-5b7e-43b6-bef9-2acd75976c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:34.275504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8e41-5b7e-43b6-bef9-2acd75976c4e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:34.275784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8e41-5b7e-43b6-bef9-2acd75976c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:34.276055 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df8e41-5b7e-43b6-bef9-2acd75976c4e None admin] PATH_INFO: `/v3/users/d114912561a948d28706552e1b9b6bc5` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:34.277305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df8e41-5b7e-43b6-bef9-2acd75976c4e None admin] RBAC: Authorizing `identity:get_user(user_id=d114912561a948d28706552e1b9b6bc5)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:34.278795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df8e41-5b7e-43b6-bef9-2acd75976c4e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:34.280644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 151/284] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:34 2022] GET /identity/v3/users/d114912561a948d28706552e1b9b6bc5 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:34.286500 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:34.363580 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:34.409407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205695f-7da2-48aa-bc26-29470445fff5 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:34.452320 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1818966-a8f8-4d91-af94-87e896dca3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:34.452979 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818966-a8f8-4d91-af94-87e896dca3e3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:34.453252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818966-a8f8-4d91-af94-87e896dca3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:34.453635 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1818966-a8f8-4d91-af94-87e896dca3e3 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:34.454872 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1818966-a8f8-4d91-af94-87e896dca3e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:34.456396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1818966-a8f8-4d91-af94-87e896dca3e3 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:34.458514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 134/285] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:34 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:34.464214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df8e41-5b7e-43b6-bef9-2acd75976c4e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:34.623074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df8e41-5b7e-43b6-bef9-2acd75976c4e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:34.670743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8a779-b945-4a16-b6af-8813e3b71146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:34.671424 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8a779-b945-4a16-b6af-8813e3b71146 None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:34.671701 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8a779-b945-4a16-b6af-8813e3b71146 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:34.671976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8a779-b945-4a16-b6af-8813e3b71146 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac/users/d114912561a948d28706552e1b9b6bc5/roles/0c2da9b50ef4450c98676939632e93b6` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:34.673986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8a779-b945-4a16-b6af-8813e3b71146 None admin] RBAC: Authorizing `identity:create_grant(project_id=a92fe046f9574126b7da24bbab315fac, user_id=d114912561a948d28706552e1b9b6bc5, role_id=0c2da9b50ef4450c98676939632e93b6)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:34.675436 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8a779-b945-4a16-b6af-8813e3b71146 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:34.780276 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 152/286] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:48:34 2022] PUT /identity/v3/projects/a92fe046f9574126b7da24bbab315fac/users/d114912561a948d28706552e1b9b6bc5/roles/0c2da9b50ef4450c98676939632e93b6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:34.973402 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5416-0fd9-4d94-84bd-f34c94d8c9bc None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:34.973792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5416-0fd9-4d94-84bd-f34c94d8c9bc None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:34.973967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5416-0fd9-4d94-84bd-f34c94d8c9bc None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:34.975576 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 135/287] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:34.981648 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d394ea7-d75a-4a9a-8d59-0e2df918f01f None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:34.981959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d394ea7-d75a-4a9a-8d59-0e2df918f01f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:34.982235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d394ea7-d75a-4a9a-8d59-0e2df918f01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:34.991046 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:35.004390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-2d394ea7-d75a-4a9a-8d59-0e2df918f01f None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:35.005641 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-2d394ea7-d75a-4a9a-8d59-0e2df918f01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:35.104696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 153/288] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:35.481317 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5416-0fd9-4d94-84bd-f34c94d8c9bc None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:35.647279 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5416-0fd9-4d94-84bd-f34c94d8c9bc None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:35.686472 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:35.691812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7255579-c8a4-4918-9b76-a42a38994489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:35.692453 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7255579-c8a4-4918-9b76-a42a38994489 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:35.692728 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7255579-c8a4-4918-9b76-a42a38994489 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:35.692997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7255579-c8a4-4918-9b76-a42a38994489 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:35.707514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7255579-c8a4-4918-9b76-a42a38994489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-a7255579-c8a4-4918-9b76-a42a38994489 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:35.713363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:35.714262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:35.715060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 136/289] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:35.722080 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d394ea7-d75a-4a9a-8d59-0e2df918f01f None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:35.856668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d394ea7-d75a-4a9a-8d59-0e2df918f01f None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:35.901069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:35.901705 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:35.901985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:35.902259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:35.902922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:35.903223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:35.904606 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:35.906025 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:35.917008 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 154/290] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:35.923613 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7255579-c8a4-4918-9b76-a42a38994489 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:36.089698 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7255579-c8a4-4918-9b76-a42a38994489 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:36.135134 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7dd1-4c9f-460d-87c2-ebfd3d0da3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:36.135771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7dd1-4c9f-460d-87c2-ebfd3d0da3b6 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:36.136050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7dd1-4c9f-460d-87c2-ebfd3d0da3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:36.136317 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7dd1-4c9f-460d-87c2-ebfd3d0da3b6 None admin] PATH_INFO: `/v3/users/59c709936c0a43e0a5b50503564de521` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:36.137461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b7dd1-4c9f-460d-87c2-ebfd3d0da3b6 None admin] RBAC: Authorizing `identity:get_user(user_id=59c709936c0a43e0a5b50503564de521)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:36.138919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b7dd1-4c9f-460d-87c2-ebfd3d0da3b6 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:36.140794 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 137/291] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:35 2022] GET /identity/v3/users/59c709936c0a43e0a5b50503564de521 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:36.146402 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:36.293837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138e5e0-94e1-4dd1-b98c-c78d24703786 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:36.340913 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e471b-b40f-4295-9bca-bc7e82b95a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:36.341569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e471b-b40f-4295-9bca-bc7e82b95a2f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:36.341850 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e471b-b40f-4295-9bca-bc7e82b95a2f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:36.342125 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e471b-b40f-4295-9bca-bc7e82b95a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:36.411700 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:36.419320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e471b-b40f-4295-9bca-bc7e82b95a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:36.420823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e471b-b40f-4295-9bca-bc7e82b95a2f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:36.525464 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 155/292] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:36.538579 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7dd1-4c9f-460d-87c2-ebfd3d0da3b6 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:36.641042 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:36.704880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7dd1-4c9f-460d-87c2-ebfd3d0da3b6 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:36.754224 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e1fc5-055a-4e0e-ab34-9c7f29c74bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:36.754910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1fc5-055a-4e0e-ab34-9c7f29c74bd4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:36.755189 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1fc5-055a-4e0e-ab34-9c7f29c74bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:36.755458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1fc5-055a-4e0e-ab34-9c7f29c74bd4 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:36.756562 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1fc5-055a-4e0e-ab34-9c7f29c74bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:36.758635 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1fc5-055a-4e0e-ab34-9c7f29c74bd4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:36.760425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 138/293] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:36 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:36.769530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e471b-b40f-4295-9bca-bc7e82b95a2f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:36.850765 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67151a1-d3ec-41c6-889e-a8a580b2f403 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:36.851088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67151a1-d3ec-41c6-889e-a8a580b2f403 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:36.851313 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67151a1-d3ec-41c6-889e-a8a580b2f403 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:36.853216 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 139/294] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:36.858714 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa9284-235d-4967-8d10-8b0197cb15e2 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:36.858992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa9284-235d-4967-8d10-8b0197cb15e2 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:36.859320 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa9284-235d-4967-8d10-8b0197cb15e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:36.869982 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:36.882548 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e471b-b40f-4295-9bca-bc7e82b95a2f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:36.894080 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-13fa9284-235d-4967-8d10-8b0197cb15e2 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:36.895534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-13fa9284-235d-4967-8d10-8b0197cb15e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:36.941745 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da8e50-462d-4664-a35e-c2b7cab426ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:36.943448 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8e50-462d-4664-a35e-c2b7cab426ca None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:36.944789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8e50-462d-4664-a35e-c2b7cab426ca None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:36.945076 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da8e50-462d-4664-a35e-c2b7cab426ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:36.946617 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da8e50-462d-4664-a35e-c2b7cab426ca None admin] RBAC: Adding query filter params (role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=a92fe046f9574126b7da24bbab315fac, user.id=59c709936c0a43e0a5b50503564de521) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:36.946938 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da8e50-462d-4664-a35e-c2b7cab426ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:36.948399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da8e50-462d-4664-a35e-c2b7cab426ca None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:36.958114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 156/295] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:36 2022] GET /identity/v3/role_assignments?user.id=59c709936c0a43e0a5b50503564de521&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:36.958114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d45b6-8ac6-4f40-a08b-f1c2f212a16e None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:36.958114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d45b6-8ac6-4f40-a08b-f1c2f212a16e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:36.958114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d45b6-8ac6-4f40-a08b-f1c2f212a16e None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:36.958114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 157/296] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:36.965442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6990-9439-4305-8e4d-0158876f4da6 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:36.965442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6990-9439-4305-8e4d-0158876f4da6 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:36.965442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6990-9439-4305-8e4d-0158876f4da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:36.983271 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-66ee6990-9439-4305-8e4d-0158876f4da6 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:36.986446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-66ee6990-9439-4305-8e4d-0158876f4da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:37.034485 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 140/297] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:37.062862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 158/298] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:37.182662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b89c-1fe1-49fe-a5a9-7046aea53599 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.183317 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b89c-1fe1-49fe-a5a9-7046aea53599 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.183788 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051b89c-1fe1-49fe-a5a9-7046aea53599 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.185690 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 141/299] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:37.190782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13df1-9487-4672-aded-99a9a6e38731 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.191065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13df1-9487-4672-aded-99a9a6e38731 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.191338 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d13df1-9487-4672-aded-99a9a6e38731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.218656 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-a7d13df1-9487-4672-aded-99a9a6e38731 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:37.219804 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-a7d13df1-9487-4672-aded-99a9a6e38731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:37.304504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 159/300] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:37.453058 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051b89c-1fe1-49fe-a5a9-7046aea53599 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:37.492846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d13df1-9487-4672-aded-99a9a6e38731 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:37.516453 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:37.541664 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:37.596047 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051b89c-1fe1-49fe-a5a9-7046aea53599 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:37.622996 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d13df1-9487-4672-aded-99a9a6e38731 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:37.645897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530febf3-4177-4924-aba8-0f1ec2b15853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:37.646885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530febf3-4177-4924-aba8-0f1ec2b15853 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.647359 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530febf3-4177-4924-aba8-0f1ec2b15853 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.647822 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530febf3-4177-4924-aba8-0f1ec2b15853 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.659243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530febf3-4177-4924-aba8-0f1ec2b15853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:37.666889 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae00740-64e3-43af-b743-46ec4cda5f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-530febf3-4177-4924-aba8-0f1ec2b15853 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:37.667255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:37.668098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:37.668897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:37.669563 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae00740-64e3-43af-b743-46ec4cda5f95 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.669563 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae00740-64e3-43af-b743-46ec4cda5f95 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.669563 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae00740-64e3-43af-b743-46ec4cda5f95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.670920 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 142/301] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:37.671394 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae00740-64e3-43af-b743-46ec4cda5f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:37.672897 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae00740-64e3-43af-b743-46ec4cda5f95 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:37.677343 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530febf3-4177-4924-aba8-0f1ec2b15853 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:37.677515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 160/302] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:37.682549 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae00740-64e3-43af-b743-46ec4cda5f95 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:37.777824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:37.787698 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530febf3-4177-4924-aba8-0f1ec2b15853 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:37.790651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae00740-64e3-43af-b743-46ec4cda5f95 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:37.806722 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:37.823971 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6878c76-79d6-479b-a151-d44135857e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:37.824593 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878c76-79d6-479b-a151-d44135857e3c None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.824865 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878c76-79d6-479b-a151-d44135857e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.825139 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6878c76-79d6-479b-a151-d44135857e3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.825712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:37.826324 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.826604 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.826878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.827537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:37.827838 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:37.829208 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:37.835822 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6878c76-79d6-479b-a151-d44135857e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:37.837233 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 161/303] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:37.839198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-f6878c76-79d6-479b-a151-d44135857e3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:37.840849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:37.841998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:37.842899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 143/304] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:37.843556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359460-2ed0-43ff-ae57-c9e8cf7c18a3 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.843556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359460-2ed0-43ff-ae57-c9e8cf7c18a3 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.843556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61359460-2ed0-43ff-ae57-c9e8cf7c18a3 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.845025 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 144/305] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:37.845825 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61359460-2ed0-43ff-ae57-c9e8cf7c18a3 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:37.939614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990b9c-f8da-44cb-b37f-33bc917986ae None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:37.948914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61359460-2ed0-43ff-ae57-c9e8cf7c18a3 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:37.971708 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8a17a-fffb-4b09-8c27-0bee4399a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:37.972311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8a17a-fffb-4b09-8c27-0bee4399a8cf None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.972593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8a17a-fffb-4b09-8c27-0bee4399a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.972863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8a17a-fffb-4b09-8c27-0bee4399a8cf None admin] PATH_INFO: `/v3/groups` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.973504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8a17a-fffb-4b09-8c27-0bee4399a8cf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:37.974936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8a17a-fffb-4b09-8c27-0bee4399a8cf None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:37.982172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b5768-85ca-46cd-ab0f-482acc2f4c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:37.982798 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5768-85ca-46cd-ab0f-482acc2f4c96 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.983092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5768-85ca-46cd-ab0f-482acc2f4c96 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.983345 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b5768-85ca-46cd-ab0f-482acc2f4c96 None admin] PATH_INFO: `/v3/users/0787b6f4aa954a09b999848c2cf4a5ef` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:37.984476 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b5768-85ca-46cd-ab0f-482acc2f4c96 None admin] RBAC: Authorizing `identity:get_user(user_id=0787b6f4aa954a09b999848c2cf4a5ef)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:37.985960 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b5768-85ca-46cd-ab0f-482acc2f4c96 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:37.987513 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 145/306] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:37 2022] GET /identity/v3/users/0787b6f4aa954a09b999848c2cf4a5ef => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:37.988746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c03a2-29cb-46cf-b73f-f3c6c35c237b None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:37.989027 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c03a2-29cb-46cf-b73f-f3c6c35c237b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:37.989299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c03a2-29cb-46cf-b73f-f3c6c35c237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:38.007115 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-b08c03a2-29cb-46cf-b73f-f3c6c35c237b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:38.008328 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-b08c03a2-29cb-46cf-b73f-f3c6c35c237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:38.036330 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 162/307] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Aug 19 17:48:37 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:48:38.037177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8a17a-fffb-4b09-8c27-0bee4399a8cf None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:38.050976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:38.056371 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:38.097459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 146/308] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:38.097459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c03a2-29cb-46cf-b73f-f3c6c35c237b None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:38.155051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8a17a-fffb-4b09-8c27-0bee4399a8cf None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:38.193578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:38.194287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:38.194957 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:38.195634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:38.197545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:38.198007 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:38.199529 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:38.208997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 163/309] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:38.216481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:38.236947 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c03a2-29cb-46cf-b73f-f3c6c35c237b None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:38.278746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66ed63-1f38-4cb6-98f8-5ed2707c99bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:38.279401 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66ed63-1f38-4cb6-98f8-5ed2707c99bb None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:38.279675 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66ed63-1f38-4cb6-98f8-5ed2707c99bb None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:38.279945 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66ed63-1f38-4cb6-98f8-5ed2707c99bb None admin] PATH_INFO: `/v3/system/users/0787b6f4aa954a09b999848c2cf4a5ef/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:38.281328 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66ed63-1f38-4cb6-98f8-5ed2707c99bb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0787b6f4aa954a09b999848c2cf4a5ef, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:38.282721 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66ed63-1f38-4cb6-98f8-5ed2707c99bb None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:38.321989 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:38.338310 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48a7d9-3328-4d0b-a78a-7919b71584bd None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:38.357339 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 147/310] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Aug 19 17:48:38 2022] PUT /identity/v3/system/users/0787b6f4aa954a09b999848c2cf4a5ef/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:38.382727 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd3b91-55a4-4601-8720-161a12bd004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:38.383911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3b91-55a4-4601-8720-161a12bd004e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:38.384540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3b91-55a4-4601-8720-161a12bd004e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:38.385064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd3b91-55a4-4601-8720-161a12bd004e None admin] PATH_INFO: `/v3/users/cbf67fea7aa048e3ab704d3bed639b25` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:38.403287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd3b91-55a4-4601-8720-161a12bd004e None admin] RBAC: Authorizing `identity:get_user(user_id=cbf67fea7aa048e3ab704d3bed639b25)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:38.405214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd3b91-55a4-4601-8720-161a12bd004e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:38.407638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 164/311] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:38 2022] GET /identity/v3/users/cbf67fea7aa048e3ab704d3bed639b25 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:38.413497 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66ed63-1f38-4cb6-98f8-5ed2707c99bb None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:38.468739 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:38.469787 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd3b91-55a4-4601-8720-161a12bd004e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:38.537260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66ed63-1f38-4cb6-98f8-5ed2707c99bb None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:38.583453 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:38.584063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:38.584286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:38.584526 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:38.585254 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] RBAC: Adding query filter params (role.id=0c2da9b50ef4450c98676939632e93b6, user.id=cbf67fea7aa048e3ab704d3bed639b25, scope.system=all) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:38.585611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:38.587899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:38.594830 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 148/312] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Aug 19 17:48:38 2022] GET /identity/v3/role_assignments?user.id=cbf67fea7aa048e3ab704d3bed639b25&scope.system=all&role.id=0c2da9b50ef4450c98676939632e93b6 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:38.623878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd3b91-55a4-4601-8720-161a12bd004e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:38.663964 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:38.671650 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e84c2-f453-4162-b7c4-05127ae60751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:38.677638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e84c2-f453-4162-b7c4-05127ae60751 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:38.677638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e84c2-f453-4162-b7c4-05127ae60751 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:38.677638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e84c2-f453-4162-b7c4-05127ae60751 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:38.685784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e84c2-f453-4162-b7c4-05127ae60751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-394e84c2-f453-4162-b7c4-05127ae60751 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:38.691035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:38.692177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:38.693506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 165/313] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:38.701067 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:38.815745 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95101594-69c6-4024-8a2e-8ea080b21365 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:38.818534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:38.852564 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:38.853547 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:38.854026 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:38.854495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:38.855356 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:38.855857 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:38.857458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:38.869539 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 149/314] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:38.872994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e84c2-f453-4162-b7c4-05127ae60751 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:38.983225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e84c2-f453-4162-b7c4-05127ae60751 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:39.019674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22309fcc-9e42-4b19-9bb6-5fff5f157c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:39.020463 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309fcc-9e42-4b19-9bb6-5fff5f157c5b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:39.020743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309fcc-9e42-4b19-9bb6-5fff5f157c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:39.021010 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22309fcc-9e42-4b19-9bb6-5fff5f157c5b None admin] PATH_INFO: `/v3/users/d114912561a948d28706552e1b9b6bc5` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:39.022211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22309fcc-9e42-4b19-9bb6-5fff5f157c5b None admin] RBAC: Authorizing `identity:get_user(user_id=d114912561a948d28706552e1b9b6bc5)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:39.024196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22309fcc-9e42-4b19-9bb6-5fff5f157c5b None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:39.026409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 166/315] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:38 2022] GET /identity/v3/users/d114912561a948d28706552e1b9b6bc5 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:39.031697 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:39.138601 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960b638-ea1e-4bdc-8692-baf78d651979 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:39.178761 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650badc-5331-42cc-8653-ba3b5783e885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:39.179376 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650badc-5331-42cc-8653-ba3b5783e885 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:39.179655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650badc-5331-42cc-8653-ba3b5783e885 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:39.180085 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650badc-5331-42cc-8653-ba3b5783e885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:39.216597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:39.251188 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650badc-5331-42cc-8653-ba3b5783e885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:39.252738 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650badc-5331-42cc-8653-ba3b5783e885 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:39.366451 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 150/316] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:39.372746 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22309fcc-9e42-4b19-9bb6-5fff5f157c5b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:39.441910 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:39.487111 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22309fcc-9e42-4b19-9bb6-5fff5f157c5b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:39.529023 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbebe3-af84-41dd-83dd-603488c62bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:39.529731 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbebe3-af84-41dd-83dd-603488c62bcd None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:39.530013 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbebe3-af84-41dd-83dd-603488c62bcd None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:39.530285 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbebe3-af84-41dd-83dd-603488c62bcd None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:39.531506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbebe3-af84-41dd-83dd-603488c62bcd None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:39.533001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbebe3-af84-41dd-83dd-603488c62bcd None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:39.535302 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 167/317] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:39 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:39.542004 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650badc-5331-42cc-8653-ba3b5783e885 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:39.610052 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:39.644872 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650badc-5331-42cc-8653-ba3b5783e885 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:39.680454 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa253f0f-2807-4323-bc01-66c793aaa738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:39.681077 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253f0f-2807-4323-bc01-66c793aaa738 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:39.681355 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253f0f-2807-4323-bc01-66c793aaa738 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:39.681667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253f0f-2807-4323-bc01-66c793aaa738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:39.682383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa253f0f-2807-4323-bc01-66c793aaa738 None admin] RBAC: Adding query filter params (role.id=0c2da9b50ef4450c98676939632e93b6, scope.project.id=a92fe046f9574126b7da24bbab315fac, user.id=d114912561a948d28706552e1b9b6bc5) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:39.682689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa253f0f-2807-4323-bc01-66c793aaa738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:39.684124 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa253f0f-2807-4323-bc01-66c793aaa738 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:39.690474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 151/318] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:48:39 2022] GET /identity/v3/role_assignments?user.id=d114912561a948d28706552e1b9b6bc5&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=0c2da9b50ef4450c98676939632e93b6 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:40.417485 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4b455-0719-466a-9bec-6caa4e45c488 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:40.418373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4b455-0719-466a-9bec-6caa4e45c488 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:40.418654 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4b455-0719-466a-9bec-6caa4e45c488 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:40.420140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 168/319] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:40.425142 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9fbd-847b-49d8-916e-bfc25987eaa2 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:40.425449 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9fbd-847b-49d8-916e-bfc25987eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:40.425730 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb9fbd-847b-49d8-916e-bfc25987eaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:40.444285 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-3dbb9fbd-847b-49d8-916e-bfc25987eaa2 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:40.448094 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-3dbb9fbd-847b-49d8-916e-bfc25987eaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:40.523437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 152/320] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:40.634776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cedb3f-526c-41f9-9499-ee3e39b1d36d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:40.635083 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cedb3f-526c-41f9-9499-ee3e39b1d36d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:40.635316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cedb3f-526c-41f9-9499-ee3e39b1d36d None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:40.636769 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 169/321] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:40.641781 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf306be-82a4-4992-833b-a1cfb50186ac None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:40.642206 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf306be-82a4-4992-833b-a1cfb50186ac None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:40.642352 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf306be-82a4-4992-833b-a1cfb50186ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:40.660703 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-5cf306be-82a4-4992-833b-a1cfb50186ac None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:40.661895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-5cf306be-82a4-4992-833b-a1cfb50186ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:40.719533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:40.731997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 153/322] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:40.852850 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cedb3f-526c-41f9-9499-ee3e39b1d36d None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:40.955691 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303923-e4cb-4730-a36c-a06263ba624b None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:40.955909 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cedb3f-526c-41f9-9499-ee3e39b1d36d None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:40.955991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303923-e4cb-4730-a36c-a06263ba624b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:40.956233 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65303923-e4cb-4730-a36c-a06263ba624b None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:40.957618 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 154/323] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:48:40.963549 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d68d5-d5f4-4e6c-9ee2-108ec52ebe92 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:40.963907 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d68d5-d5f4-4e6c-9ee2-108ec52ebe92 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:40.964329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d68d5-d5f4-4e6c-9ee2-108ec52ebe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:40.983354 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:40.983506 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d02d68d5-d5f4-4e6c-9ee2-108ec52ebe92 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:40.985228 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d02d68d5-d5f4-4e6c-9ee2-108ec52ebe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:40.992206 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864597e-d9e8-4ab6-838c-0d59163f19c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:40.993743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864597e-d9e8-4ab6-838c-0d59163f19c2 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:40.993743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864597e-d9e8-4ab6-838c-0d59163f19c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:40.993914 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864597e-d9e8-4ab6-838c-0d59163f19c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:40.994946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864597e-d9e8-4ab6-838c-0d59163f19c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:40.996390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864597e-d9e8-4ab6-838c-0d59163f19c2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:40.998549 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 170/324] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:48:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:41.003467 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864597e-d9e8-4ab6-838c-0d59163f19c2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:41.080877 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 155/325] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:41.081790 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d68d5-d5f4-4e6c-9ee2-108ec52ebe92 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:41.122569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864597e-d9e8-4ab6-838c-0d59163f19c2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:41.160772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d222b-f1d0-488e-8134-f992b3fcc987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:41.161411 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d222b-f1d0-488e-8134-f992b3fcc987 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:41.161719 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d222b-f1d0-488e-8134-f992b3fcc987 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:41.161998 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d222b-f1d0-488e-8134-f992b3fcc987 None admin] PATH_INFO: `/v3/groups` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:41.162610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d222b-f1d0-488e-8134-f992b3fcc987 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:41.164104 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d222b-f1d0-488e-8134-f992b3fcc987 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:41.191546 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d68d5-d5f4-4e6c-9ee2-108ec52ebe92 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:41.212960 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:41.226859 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff70b04-48b8-41d3-902e-f40a0e6f35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:41.227516 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70b04-48b8-41d3-902e-f40a0e6f35bf None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:41.227800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70b04-48b8-41d3-902e-f40a0e6f35bf None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:41.228069 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff70b04-48b8-41d3-902e-f40a0e6f35bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:41.238264 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff70b04-48b8-41d3-902e-f40a0e6f35bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-4ff70b04-48b8-41d3-902e-f40a0e6f35bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:41.243491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:41.244705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:41.245680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 156/326] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:41.250204 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff70b04-48b8-41d3-902e-f40a0e6f35bf None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:41.259082 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 171/327] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Aug 19 17:48:41 2022] POST /identity/v3/groups => generated 226 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:48:41.363321 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff70b04-48b8-41d3-902e-f40a0e6f35bf None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:41.400872 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:41.401550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:41.401835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:41.402133 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:41.402790 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] RBAC: Adding query filter params (name=member) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:41.403095 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:41.404615 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:41.409885 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d222b-f1d0-488e-8134-f992b3fcc987 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:41.415211 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 157/328] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:41.420931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:41.472019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:41.479370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:41.533180 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d222b-f1d0-488e-8134-f992b3fcc987 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:41.544765 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad7ff8-48e1-4512-8a0c-9037802f2738 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:41.577494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d7e2a-3265-4ada-bc33-50b17fb5a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:41.578551 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7e2a-3265-4ada-bc33-50b17fb5a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:41.579098 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7e2a-3265-4ada-bc33-50b17fb5a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:41.579531 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d7e2a-3265-4ada-bc33-50b17fb5a8c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:41.582802 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adf754-28ee-4d5a-b631-1c50180674aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:41.583444 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf754-28ee-4d5a-b631-1c50180674aa None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:41.583727 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf754-28ee-4d5a-b631-1c50180674aa None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:41.584003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adf754-28ee-4d5a-b631-1c50180674aa None admin] PATH_INFO: `/v3/users/0787b6f4aa954a09b999848c2cf4a5ef` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:41.585154 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adf754-28ee-4d5a-b631-1c50180674aa None admin] RBAC: Authorizing `identity:get_user(user_id=0787b6f4aa954a09b999848c2cf4a5ef)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:41.587198 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adf754-28ee-4d5a-b631-1c50180674aa None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:41.588971 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 158/329] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:41 2022] GET /identity/v3/users/0787b6f4aa954a09b999848c2cf4a5ef => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:41.593736 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d7e2a-3265-4ada-bc33-50b17fb5a8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:41.594576 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adf754-28ee-4d5a-b631-1c50180674aa None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-2c8d7e2a-3265-4ada-bc33-50b17fb5a8c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:41.601112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:41.602507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:41.603514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:41.606314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 172/330] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:41.612096 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d7e2a-3265-4ada-bc33-50b17fb5a8c5 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:41.725306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adf754-28ee-4d5a-b631-1c50180674aa None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:41.737127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:41.742891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d7e2a-3265-4ada-bc33-50b17fb5a8c5 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:41.760860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:41.764785 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:41.765394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:41.765702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:41.765972 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:41.766694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] RBAC: Adding query filter params (role.id=6126abc4720c4543854a6fd2ddfacbbf, user.id=0787b6f4aa954a09b999848c2cf4a5ef, scope.system=all) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:41.767000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:41.768443 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:41.784686 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 159/331] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Aug 19 17:48:41 2022] GET /identity/v3/role_assignments?user.id=0787b6f4aa954a09b999848c2cf4a5ef&scope.system=all&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:41.789132 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:41.790090 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:41.790547 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:41.790997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:41.791893 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:41.792391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:41.794096 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:41.806784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 173/332] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:41.813462 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:41.951277 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90211512-f840-4a15-9cb9-b17e1d163348 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:41.997190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6954cc1-9a58-415c-949c-b0bbf5ad6f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:41.997861 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954cc1-9a58-415c-949c-b0bbf5ad6f11 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:41.998138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954cc1-9a58-415c-949c-b0bbf5ad6f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:41.998408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6954cc1-9a58-415c-949c-b0bbf5ad6f11 None admin] PATH_INFO: `/v3/users/cbf67fea7aa048e3ab704d3bed639b25` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:41.999530 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6954cc1-9a58-415c-949c-b0bbf5ad6f11 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf67fea7aa048e3ab704d3bed639b25)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:42.000963 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6954cc1-9a58-415c-949c-b0bbf5ad6f11 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:42.002696 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 160/333] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:41 2022] GET /identity/v3/users/cbf67fea7aa048e3ab704d3bed639b25 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:42.008913 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:42.136884 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34bf6-a5f3-4fd2-9771-08a4347f985c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:42.175668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380161d5-fb3a-45d8-8500-23f2dde9c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:42.176327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380161d5-fb3a-45d8-8500-23f2dde9c9da None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:42.176606 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380161d5-fb3a-45d8-8500-23f2dde9c9da None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:42.176879 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380161d5-fb3a-45d8-8500-23f2dde9c9da None admin] PATH_INFO: `/v3/system/users/cbf67fea7aa048e3ab704d3bed639b25/roles/0c2da9b50ef4450c98676939632e93b6` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:42.178358 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380161d5-fb3a-45d8-8500-23f2dde9c9da None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cbf67fea7aa048e3ab704d3bed639b25, role_id=0c2da9b50ef4450c98676939632e93b6)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:42.179775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380161d5-fb3a-45d8-8500-23f2dde9c9da None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:42.255003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 174/334] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Aug 19 17:48:42 2022] PUT /identity/v3/system/users/cbf67fea7aa048e3ab704d3bed639b25/roles/0c2da9b50ef4450c98676939632e93b6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:44.145469 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafffec-a27b-47cc-913b-ca294130bb0c None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:44.146013 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafffec-a27b-47cc-913b-ca294130bb0c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:44.146013 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafffec-a27b-47cc-913b-ca294130bb0c None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:44.147588 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 161/335] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:44.153067 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6118-cf6a-4a5c-8848-a642e69afa32 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:44.153875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6118-cf6a-4a5c-8848-a642e69afa32 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:44.154372 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c6118-cf6a-4a5c-8848-a642e69afa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:44.186754 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-002c6118-cf6a-4a5c-8848-a642e69afa32 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:44.188374 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-002c6118-cf6a-4a5c-8848-a642e69afa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:44.243599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:44.272424 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2ca9-fd57-4e5c-ba74-72a498983ed5 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:44.273080 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2ca9-fd57-4e5c-ba74-72a498983ed5 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:44.273709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2ca9-fd57-4e5c-ba74-72a498983ed5 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:44.275491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 162/336] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:44.280538 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267269e8-60b4-4164-9d6f-d6b0fadc1c6c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:44.281156 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267269e8-60b4-4164-9d6f-d6b0fadc1c6c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:44.281666 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267269e8-60b4-4164-9d6f-d6b0fadc1c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:44.286343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 175/337] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:44.310819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-267269e8-60b4-4164-9d6f-d6b0fadc1c6c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:44.312322 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-267269e8-60b4-4164-9d6f-d6b0fadc1c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:44.352158 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:44.404329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 163/338] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:44.789697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6118-cf6a-4a5c-8848-a642e69afa32 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:44.916641 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c6118-cf6a-4a5c-8848-a642e69afa32 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:44.940239 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197797b-c1ea-4bca-b827-d3ee44715459 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:44.940908 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197797b-c1ea-4bca-b827-d3ee44715459 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:44.941606 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197797b-c1ea-4bca-b827-d3ee44715459 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:44.949623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 164/339] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:48:44.949623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15eaa-ff2b-48aa-a908-6703a9268dee None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:44.949623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15eaa-ff2b-48aa-a908-6703a9268dee None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:44.949623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b15eaa-ff2b-48aa-a908-6703a9268dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:45.084906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-12b15eaa-ff2b-48aa-a908-6703a9268dee None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:45.087023 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-12b15eaa-ff2b-48aa-a908-6703a9268dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:45.120954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfdfc-0030-4caa-966f-6b5d1fe40ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:45.121711 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfdfc-0030-4caa-966f-6b5d1fe40ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:45.121999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfdfc-0030-4caa-966f-6b5d1fe40ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:45.122269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cfdfc-0030-4caa-966f-6b5d1fe40ee3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:45.146072 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cfdfc-0030-4caa-966f-6b5d1fe40ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-de5cfdfc-0030-4caa-966f-6b5d1fe40ee3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:45.153605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:45.154948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:45.155773 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 176/340] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:45.164209 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfdfc-0030-4caa-966f-6b5d1fe40ee3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:45.249179 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:45.260092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 165/341] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:45.260965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b15eaa-ff2b-48aa-a908-6703a9268dee None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:45.416513 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cfdfc-0030-4caa-966f-6b5d1fe40ee3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:45.485571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:45.493528 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b15eaa-ff2b-48aa-a908-6703a9268dee None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:45.503032 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e14a70-d2bc-4b36-a8cf-bb6e2b13c948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:45.514343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14a70-d2bc-4b36-a8cf-bb6e2b13c948 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:45.514343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14a70-d2bc-4b36-a8cf-bb6e2b13c948 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:45.514343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e14a70-d2bc-4b36-a8cf-bb6e2b13c948 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:45.525171 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e14a70-d2bc-4b36-a8cf-bb6e2b13c948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-41e14a70-d2bc-4b36-a8cf-bb6e2b13c948 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:45.530370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:45.531223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:45.532020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:45.535200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 177/342] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:45.541321 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e14a70-d2bc-4b36-a8cf-bb6e2b13c948 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:45.584837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:45.585490 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:45.586367 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:45.586645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:45.587314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:45.587612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:45.588972 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:45.611649 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 166/343] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:45.618570 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:45.724457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:45.745159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e14a70-d2bc-4b36-a8cf-bb6e2b13c948 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:45.812590 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3e740-1aae-422b-ace8-b5117759004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:45.813216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3e740-1aae-422b-ace8-b5117759004a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:45.813526 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3e740-1aae-422b-ace8-b5117759004a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:45.813804 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3e740-1aae-422b-ace8-b5117759004a None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:45.814472 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3e740-1aae-422b-ace8-b5117759004a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:45.814778 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3e740-1aae-422b-ace8-b5117759004a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:45.816168 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3e740-1aae-422b-ace8-b5117759004a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:45.828378 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5df9a-6d8b-4209-a6d3-ab161d6dc2c4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:45.832938 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 178/344] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:45.834315 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0ed0-cd75-430e-a3f5-6c3a8a67ed0b None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:45.834594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0ed0-cd75-430e-a3f5-6c3a8a67ed0b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:45.834864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0ed0-cd75-430e-a3f5-6c3a8a67ed0b None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:45.836216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 179/345] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:45.841126 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0ed0-cd75-430e-a3f5-6c3a8a67ed0b None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:45.866346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049e9b0-0f87-4e4f-a306-ca6361b5711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:45.867590 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e9b0-0f87-4e4f-a306-ca6361b5711d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:45.867958 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e9b0-0f87-4e4f-a306-ca6361b5711d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:45.868249 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e9b0-0f87-4e4f-a306-ca6361b5711d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:45.899895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:45.950833 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049e9b0-0f87-4e4f-a306-ca6361b5711d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:45.952341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049e9b0-0f87-4e4f-a306-ca6361b5711d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:45.968181 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0ed0-cd75-430e-a3f5-6c3a8a67ed0b None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:46.014674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3dea0-0ef0-4981-9a54-33513039045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:46.015237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3dea0-0ef0-4981-9a54-33513039045c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.015515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3dea0-0ef0-4981-9a54-33513039045c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.016647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3dea0-0ef0-4981-9a54-33513039045c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.051332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:46.085471 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 167/346] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 17:48:46.087932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cff1-1587-4eeb-af11-7ff2f24ead2d None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.088051 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cff1-1587-4eeb-af11-7ff2f24ead2d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.088294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162cff1-1587-4eeb-af11-7ff2f24ead2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.109873 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-8162cff1-1587-4eeb-af11-7ff2f24ead2d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:46.110536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-8162cff1-1587-4eeb-af11-7ff2f24ead2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:46.125364 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3dea0-0ef0-4981-9a54-33513039045c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:46.126860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3dea0-0ef0-4981-9a54-33513039045c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:46.176350 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:46.198346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 168/347] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:46.199858 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162cff1-1587-4eeb-af11-7ff2f24ead2d None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:46.259182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 180/348] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:46.261537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172efd07-d100-4e0b-b0de-d0f1d533dc18 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.261968 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172efd07-d100-4e0b-b0de-d0f1d533dc18 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.262758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172efd07-d100-4e0b-b0de-d0f1d533dc18 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.265197 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 181/349] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:46.266286 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172efd07-d100-4e0b-b0de-d0f1d533dc18 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:46.340070 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:46.344114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162cff1-1587-4eeb-af11-7ff2f24ead2d None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:46.392292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf78ae-b0f5-48ed-890d-8f6f04d20205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:46.393273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf78ae-b0f5-48ed-890d-8f6f04d20205 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.393944 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf78ae-b0f5-48ed-890d-8f6f04d20205 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.394217 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf78ae-b0f5-48ed-890d-8f6f04d20205 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.405266 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172efd07-d100-4e0b-b0de-d0f1d533dc18 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:46.405478 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf78ae-b0f5-48ed-890d-8f6f04d20205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-95cf78ae-b0f5-48ed-890d-8f6f04d20205 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:46.410537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:46.411425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:46.412257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 169/350] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:46.412921 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf78ae-b0f5-48ed-890d-8f6f04d20205 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:46.452936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9ca15-8072-4ead-af4c-62afd3eef72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:46.454406 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9ca15-8072-4ead-af4c-62afd3eef72f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.454406 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9ca15-8072-4ead-af4c-62afd3eef72f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.454406 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9ca15-8072-4ead-af4c-62afd3eef72f None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.456051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9ca15-8072-4ead-af4c-62afd3eef72f None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:46.457536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9ca15-8072-4ead-af4c-62afd3eef72f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:46.459510 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 182/351] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:46 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:46.461385 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18a18e-a6fb-468a-a12e-10f3a6fc44ae None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.461900 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18a18e-a6fb-468a-a12e-10f3a6fc44ae None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.462519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18a18e-a6fb-468a-a12e-10f3a6fc44ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.473853 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:46.486611 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-0b18a18e-a6fb-468a-a12e-10f3a6fc44ae None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:46.488596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-0b18a18e-a6fb-468a-a12e-10f3a6fc44ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:46.549188 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf78ae-b0f5-48ed-890d-8f6f04d20205 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:46.580307 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 183/352] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:46.582083 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4aafa-4b3a-44db-9746-5bdd2fa0733d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.582365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4aafa-4b3a-44db-9746-5bdd2fa0733d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.583565 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4aafa-4b3a-44db-9746-5bdd2fa0733d None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.588583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 184/353] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:46.589445 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4aafa-4b3a-44db-9746-5bdd2fa0733d None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:46.596697 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc1c8-cc56-4ab0-b864-db11c323d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:46.597337 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc1c8-cc56-4ab0-b864-db11c323d200 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.597664 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc1c8-cc56-4ab0-b864-db11c323d200 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.597939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc1c8-cc56-4ab0-b864-db11c323d200 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.599060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dc1c8-cc56-4ab0-b864-db11c323d200 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:46.600513 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dc1c8-cc56-4ab0-b864-db11c323d200 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:46.603052 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 170/354] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:46 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:46.603784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc1c8-cc56-4ab0-b864-db11c323d200 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:46.652099 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:46.723222 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4aafa-4b3a-44db-9746-5bdd2fa0733d None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:46.732993 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc1c8-cc56-4ab0-b864-db11c323d200 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:46.753598 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:46.768918 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:46.769788 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.770067 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.770386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.770999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:46.771309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:46.772753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:46.773411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517942c7-f67c-40bb-b928-f2d52a48c211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:46.774256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517942c7-f67c-40bb-b928-f2d52a48c211 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.774446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517942c7-f67c-40bb-b928-f2d52a48c211 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.774835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517942c7-f67c-40bb-b928-f2d52a48c211 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.783840 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 185/355] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:46.784417 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517942c7-f67c-40bb-b928-f2d52a48c211 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:46.785576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:46.785770 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517942c7-f67c-40bb-b928-f2d52a48c211 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:46.787693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 171/356] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:46 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:46.789177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcbf5a-5e16-4cae-8ee1-7db9fd39c180 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.794266 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcbf5a-5e16-4cae-8ee1-7db9fd39c180 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.794266 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcbf5a-5e16-4cae-8ee1-7db9fd39c180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.817997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-a9bcbf5a-5e16-4cae-8ee1-7db9fd39c180 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:46.819274 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-a9bcbf5a-5e16-4cae-8ee1-7db9fd39c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:46.905493 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 172/357] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:46.909789 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcbf5a-5e16-4cae-8ee1-7db9fd39c180 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:46.916157 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8369b7-10cf-4802-9908-b3a568e358c2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:46.929907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:46.959240 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5b955-2e34-4b4a-89c5-773a037b1940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:46.959887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b955-2e34-4b4a-89c5-773a037b1940 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:46.960168 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b955-2e34-4b4a-89c5-773a037b1940 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:46.960447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5b955-2e34-4b4a-89c5-773a037b1940 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:46.976985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5b955-2e34-4b4a-89c5-773a037b1940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-05e5b955-2e34-4b4a-89c5-773a037b1940 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:46.983846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:46.984782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:46.985659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 186/358] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:46.986323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5b955-2e34-4b4a-89c5-773a037b1940 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.040665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcbf5a-5e16-4cae-8ee1-7db9fd39c180 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.052780 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:47.086709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707b04a-fcde-4f05-9e41-3aca36bd0ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.087707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b04a-fcde-4f05-9e41-3aca36bd0ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.088250 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b04a-fcde-4f05-9e41-3aca36bd0ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.088733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707b04a-fcde-4f05-9e41-3aca36bd0ba1 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.090161 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707b04a-fcde-4f05-9e41-3aca36bd0ba1 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:47.091871 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707b04a-fcde-4f05-9e41-3aca36bd0ba1 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:47.093745 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 173/359] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:46 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:47.094738 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707b04a-fcde-4f05-9e41-3aca36bd0ba1 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.106616 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5b955-2e34-4b4a-89c5-773a037b1940 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.156539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287dc01-3220-4495-949f-ab63913a490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.157150 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287dc01-3220-4495-949f-ab63913a490d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.157459 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287dc01-3220-4495-949f-ab63913a490d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.157734 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287dc01-3220-4495-949f-ab63913a490d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.213865 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:47.218225 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707b04a-fcde-4f05-9e41-3aca36bd0ba1 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.250175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287dc01-3220-4495-949f-ab63913a490d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:47.252039 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287dc01-3220-4495-949f-ab63913a490d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:47.267217 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.267835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.268115 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.268390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.272633 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] RBAC: Adding query filter params (group.id=ab6aff42ff2d4647bae190a931d580b1, role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=4604492596b94e1c8672d5c858d714f1) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:47.272633 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:47.272633 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:47.277998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 174/360] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/role_assignments?group.id=ab6aff42ff2d4647bae190a931d580b1&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:47.278826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.334607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:47.393883 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 187/361] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:47.394997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287dc01-3220-4495-949f-ab63913a490d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.431743 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321df61-c1da-4d26-95ed-f439d4275bde None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.482242 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a72dfb-7b58-45e3-b75c-31127357c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.482905 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a72dfb-7b58-45e3-b75c-31127357c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.483187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a72dfb-7b58-45e3-b75c-31127357c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.483465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a72dfb-7b58-45e3-b75c-31127357c4a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.502225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:47.514401 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a72dfb-7b58-45e3-b75c-31127357c4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-98a72dfb-7b58-45e3-b75c-31127357c4a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:47.526656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:47.527612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:47.528415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:47.529618 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 175/362] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:47.532995 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a72dfb-7b58-45e3-b75c-31127357c4a4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.540535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287dc01-3220-4495-949f-ab63913a490d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.585178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.586274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.586558 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.586905 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.587411 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:47.587716 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:47.592601 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:47.600890 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 188/363] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:47.604424 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.671380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a72dfb-7b58-45e3-b75c-31127357c4a4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.673028 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:47.716545 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.717161 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.718620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.718620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.718620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] RBAC: Adding query filter params (group.id=ab6aff42ff2d4647bae190a931d580b1, role.id=0e16d3dcd8e045fe89150feef6d93543, scope.project.id=4604492596b94e1c8672d5c858d714f1) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:47.718871 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:47.720241 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:47.727937 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 176/364] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/role_assignments?group.id=ab6aff42ff2d4647bae190a931d580b1&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=0e16d3dcd8e045fe89150feef6d93543 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:47.730548 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.731924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3804a-60d7-48cd-9467-83fb709abd19 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.773873 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866326ea-5efe-4027-ad80-c29c666a2d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.775051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866326ea-5efe-4027-ad80-c29c666a2d07 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.775051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866326ea-5efe-4027-ad80-c29c666a2d07 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866326ea-5efe-4027-ad80-c29c666a2d07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.777783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:47.788945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866326ea-5efe-4027-ad80-c29c666a2d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-866326ea-5efe-4027-ad80-c29c666a2d07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:47.795350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:47.796357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:47.797159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 189/365] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:47.797857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866326ea-5efe-4027-ad80-c29c666a2d07 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.883284 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c03c5-cd33-444d-89cc-8f8db88cad69 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.925923 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866326ea-5efe-4027-ad80-c29c666a2d07 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:47.941062 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5b169-d6e8-4905-a6cd-7c6a49a7fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.941768 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5b169-d6e8-4905-a6cd-7c6a49a7fa55 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.942048 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5b169-d6e8-4905-a6cd-7c6a49a7fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.942319 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5b169-d6e8-4905-a6cd-7c6a49a7fa55 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.943522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5b169-d6e8-4905-a6cd-7c6a49a7fa55 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:47.945538 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5b169-d6e8-4905-a6cd-7c6a49a7fa55 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:47.951855 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 177/366] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:47.952759 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5b169-d6e8-4905-a6cd-7c6a49a7fa55 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.966025 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:47.966693 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:47.966976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:47.967247 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:47.967912 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:47.968212 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:47.969777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:47.979636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 190/367] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:47.980493 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:47.998959 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:48.045754 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:48.085165 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5b169-d6e8-4905-a6cd-7c6a49a7fa55 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:48.097580 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca638f-6aa3-409a-959a-35906ad22128 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:48.138815 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648939f6-dc64-411f-a824-32a8208e1ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:48.139456 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648939f6-dc64-411f-a824-32a8208e1ab5 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:48.139736 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648939f6-dc64-411f-a824-32a8208e1ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:48.140008 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648939f6-dc64-411f-a824-32a8208e1ab5 None admin] PATH_INFO: `/v3/users/cbf67fea7aa048e3ab704d3bed639b25` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:48.141136 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:48.141764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:48.142038 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:48.142306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:48.142750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648939f6-dc64-411f-a824-32a8208e1ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=cbf67fea7aa048e3ab704d3bed639b25)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:48.142964 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:48.143266 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:48.144657 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:48.145059 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648939f6-dc64-411f-a824-32a8208e1ab5 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:48.147292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 178/368] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/users/cbf67fea7aa048e3ab704d3bed639b25 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:48.148792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648939f6-dc64-411f-a824-32a8208e1ab5 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:48.162770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 191/369] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:48.164993 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:48.273201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648939f6-dc64-411f-a824-32a8208e1ab5 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:48.275365 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:48.298130 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b7583-0a47-4448-ad53-cdf18e8bd2de None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:48.330230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:48.335544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5486-be3a-4391-9262-4ed884bec051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:48.336238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5486-be3a-4391-9262-4ed884bec051 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:48.336544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5486-be3a-4391-9262-4ed884bec051 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:48.336819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac5486-be3a-4391-9262-4ed884bec051 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:48.338101 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac5486-be3a-4391-9262-4ed884bec051 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:48.339540 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac5486-be3a-4391-9262-4ed884bec051 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:48.346431 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 179/370] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:48 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:48.346431 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5486-be3a-4391-9262-4ed884bec051 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:48.361195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7c86-e1f2-4f6b-893e-a33fcfbffa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:48.362449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7c86-e1f2-4f6b-893e-a33fcfbffa90 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:48.363203 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7c86-e1f2-4f6b-893e-a33fcfbffa90 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:48.363702 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7c86-e1f2-4f6b-893e-a33fcfbffa90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:48.440441 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7c86-e1f2-4f6b-893e-a33fcfbffa90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:48.442914 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f7c86-e1f2-4f6b-893e-a33fcfbffa90 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:48.454749 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac5486-be3a-4391-9262-4ed884bec051 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:48.496227 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:48.497048 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:48.497243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:48.497513 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:48.498242 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] RBAC: Adding query filter params (role.id=0c2da9b50ef4450c98676939632e93b6, user.id=cbf67fea7aa048e3ab704d3bed639b25, scope.system=all) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:48.498550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:48.499992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:48.521749 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 180/371] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Aug 19 17:48:48 2022] GET /identity/v3/role_assignments?user.id=cbf67fea7aa048e3ab704d3bed639b25&scope.system=all&role.id=0c2da9b50ef4450c98676939632e93b6 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:48.522886 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:48.562340 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 192/372] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:48.563720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7c86-e1f2-4f6b-893e-a33fcfbffa90 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:48.577797 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:48.587574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:48.692745 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7c86-e1f2-4f6b-893e-a33fcfbffa90 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:48.712520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1748efc-2f32-4419-80a7-0409cf97d083 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:48.736090 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:48.737089 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:48.737616 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:48.738119 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:48.739064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] RBAC: Adding query filter params (group.id=ab6aff42ff2d4647bae190a931d580b1, role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=a92fe046f9574126b7da24bbab315fac) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:48.739579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:48.741528 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:48.750593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 193/373] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:48 2022] GET /identity/v3/role_assignments?group.id=ab6aff42ff2d4647bae190a931d580b1&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:48.751923 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:48.813578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555b256-8757-42bb-b13e-45c27b0fc1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:48.814123 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555b256-8757-42bb-b13e-45c27b0fc1eb None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:48.814389 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555b256-8757-42bb-b13e-45c27b0fc1eb None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:48.814721 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555b256-8757-42bb-b13e-45c27b0fc1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:48.908882 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:48.948676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed13eb4-4bf4-4a67-9a45-56061fc5b2ea None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:48.966609 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555b256-8757-42bb-b13e-45c27b0fc1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:48.968110 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555b256-8757-42bb-b13e-45c27b0fc1eb None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:48.995921 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cab368-fae4-468e-86dc-ac2141050bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:48.996711 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cab368-fae4-468e-86dc-ac2141050bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:48.996994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cab368-fae4-468e-86dc-ac2141050bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:48.997309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cab368-fae4-468e-86dc-ac2141050bc1 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:48.998593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cab368-fae4-468e-86dc-ac2141050bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:49.000085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cab368-fae4-468e-86dc-ac2141050bc1 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:49.001825 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 194/374] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:48 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:49.008200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cab368-fae4-468e-86dc-ac2141050bc1 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:49.017606 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:49.118758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cab368-fae4-468e-86dc-ac2141050bc1 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:49.127712 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 181/375] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:49.128657 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555b256-8757-42bb-b13e-45c27b0fc1eb None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:49.156754 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350ff5-1fe0-41b7-af98-ca301b7cf972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:49.157387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350ff5-1fe0-41b7-af98-ca301b7cf972 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:49.157707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350ff5-1fe0-41b7-af98-ca301b7cf972 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:49.157979 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c350ff5-1fe0-41b7-af98-ca301b7cf972 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:49.159346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c350ff5-1fe0-41b7-af98-ca301b7cf972 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:49.160782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c350ff5-1fe0-41b7-af98-ca301b7cf972 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:49.162685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 195/376] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:49 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:49.169854 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350ff5-1fe0-41b7-af98-ca301b7cf972 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:49.189893 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:49.275291 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c350ff5-1fe0-41b7-af98-ca301b7cf972 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:49.285667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555b256-8757-42bb-b13e-45c27b0fc1eb None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:49.310218 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:49.310825 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:49.311104 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:49.311371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:49.312086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] RBAC: Adding query filter params (group.id=ab6aff42ff2d4647bae190a931d580b1, role.id=0e16d3dcd8e045fe89150feef6d93543, scope.project.id=a92fe046f9574126b7da24bbab315fac) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:49.312392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:49.313861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:49.320616 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 196/377] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:49 2022] GET /identity/v3/role_assignments?group.id=ab6aff42ff2d4647bae190a931d580b1&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=0e16d3dcd8e045fe89150feef6d93543 => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:49.337502 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:49.355758 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3ca5-353e-47ba-9b5b-9d47438d5124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:49.356809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3ca5-353e-47ba-9b5b-9d47438d5124 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:49.357265 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3ca5-353e-47ba-9b5b-9d47438d5124 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:49.357755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3ca5-353e-47ba-9b5b-9d47438d5124 None admin] PATH_INFO: `/v3/projects/36dbac3e54734453afe30db9d0d35548` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:49.359850 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe3ca5-353e-47ba-9b5b-9d47438d5124 None admin] RBAC: Authorizing `identity:get_project(project_id=36dbac3e54734453afe30db9d0d35548)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:49.361673 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe3ca5-353e-47ba-9b5b-9d47438d5124 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:49.363628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 182/378] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:49 2022] GET /identity/v3/projects/36dbac3e54734453afe30db9d0d35548 => generated 344 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:49.370188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:49.497934 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:49.526143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0513-a2f9-44ad-a620-5d1d52c24da8 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:49.591813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35d615-d524-43fa-aa4e-1b1bfcce898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:49.592473 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35d615-d524-43fa-aa4e-1b1bfcce898a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:49.592758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35d615-d524-43fa-aa4e-1b1bfcce898a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:49.593031 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35d615-d524-43fa-aa4e-1b1bfcce898a None admin] PATH_INFO: `/v3/groups/841a51088cf54b08a58c7c784a426996` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:49.600531 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35d615-d524-43fa-aa4e-1b1bfcce898a None admin] RBAC: Authorizing `identity:get_group(group_id=841a51088cf54b08a58c7c784a426996)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:49.602067 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35d615-d524-43fa-aa4e-1b1bfcce898a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:49.603764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 197/379] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:49 2022] GET /identity/v3/groups/841a51088cf54b08a58c7c784a426996 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:49.609835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3ca5-353e-47ba-9b5b-9d47438d5124 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:49.738884 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3ca5-353e-47ba-9b5b-9d47438d5124 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:49.781227 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca2453-340b-4106-8f5f-cd215b9d7eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:49.781983 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2453-340b-4106-8f5f-cd215b9d7eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:49.782262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2453-340b-4106-8f5f-cd215b9d7eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:49.782535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca2453-340b-4106-8f5f-cd215b9d7eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:49.783269 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2453-340b-4106-8f5f-cd215b9d7eb5 None admin] RBAC: Adding query filter params (group.id=841a51088cf54b08a58c7c784a426996, role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=36dbac3e54734453afe30db9d0d35548) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:49.783577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2453-340b-4106-8f5f-cd215b9d7eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:49.785265 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca2453-340b-4106-8f5f-cd215b9d7eb5 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:49.792044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 183/380] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:49 2022] GET /identity/v3/role_assignments?group.id=841a51088cf54b08a58c7c784a426996&scope.project.id=36dbac3e54734453afe30db9d0d35548&role.id=757702b4209942a3b2ec7bf21d995169 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:50.095343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7b86-0a72-4c7e-89bd-d2799b1c7dd2 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:50.095699 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7b86-0a72-4c7e-89bd-d2799b1c7dd2 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:50.095821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b7b86-0a72-4c7e-89bd-d2799b1c7dd2 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:50.097283 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 198/381] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:50.104147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718ad5e-d267-4640-aacd-6b25fa0148f8 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:50.104437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718ad5e-d267-4640-aacd-6b25fa0148f8 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:50.104714 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718ad5e-d267-4640-aacd-6b25fa0148f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:50.127702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-f718ad5e-d267-4640-aacd-6b25fa0148f8 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:50.128911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-f718ad5e-d267-4640-aacd-6b25fa0148f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:50.199111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:50.219712 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 184/382] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:50.458791 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52417b-b073-463b-92e8-a800b45b538d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:50.459071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52417b-b073-463b-92e8-a800b45b538d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:50.459617 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52417b-b073-463b-92e8-a800b45b538d None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:50.461908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 199/383] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:50.467186 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ffe0f-1fc6-4409-b8ca-838added83e9 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:50.467471 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ffe0f-1fc6-4409-b8ca-838added83e9 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:50.467745 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ffe0f-1fc6-4409-b8ca-838added83e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:50.497451 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-246ffe0f-1fc6-4409-b8ca-838added83e9 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:50.497451 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-246ffe0f-1fc6-4409-b8ca-838added83e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:50.583696 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 185/384] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:50.692282 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52417b-b073-463b-92e8-a800b45b538d None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:50.813778 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52417b-b073-463b-92e8-a800b45b538d None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:50.849793 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470286e-6f8b-49c8-babb-76931c0efbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:50.850763 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470286e-6f8b-49c8-babb-76931c0efbd7 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:50.851365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470286e-6f8b-49c8-babb-76931c0efbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:50.851832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470286e-6f8b-49c8-babb-76931c0efbd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:50.862754 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470286e-6f8b-49c8-babb-76931c0efbd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-e470286e-6f8b-49c8-babb-76931c0efbd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:50.868891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:50.870797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:50.871597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:50.874229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 200/385] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:50.881458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ffe0f-1fc6-4409-b8ca-838added83e9 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:50.994269 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ffe0f-1fc6-4409-b8ca-838added83e9 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:51.016355 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:51.030504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:51.031116 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.031393 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.031662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.032323 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] RBAC: Adding query filter params (name=member) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:51.032670 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:51.034080 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:51.042953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 186/386] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:51.048606 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470286e-6f8b-49c8-babb-76931c0efbd7 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:51.058323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:51.172855 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:51.206433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470286e-6f8b-49c8-babb-76931c0efbd7 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:51.272506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af69d3-c2d1-4d74-99fb-365fb76ca84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:51.273872 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af69d3-c2d1-4d74-99fb-365fb76ca84f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.274166 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af69d3-c2d1-4d74-99fb-365fb76ca84f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.274441 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af69d3-c2d1-4d74-99fb-365fb76ca84f None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.278100 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af69d3-c2d1-4d74-99fb-365fb76ca84f None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:51.279831 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af69d3-c2d1-4d74-99fb-365fb76ca84f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:51.281802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 201/387] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:51 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:51.288936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af69d3-c2d1-4d74-99fb-365fb76ca84f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:51.309507 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e0a3a-0d44-4193-9373-6027d8d52674 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:51.373968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d0e95-d9e1-4483-8555-4954d9adce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:51.374630 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d0e95-d9e1-4483-8555-4954d9adce6b None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.374913 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d0e95-d9e1-4483-8555-4954d9adce6b None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.375195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d0e95-d9e1-4483-8555-4954d9adce6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.397563 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d0e95-d9e1-4483-8555-4954d9adce6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-859d0e95-d9e1-4483-8555-4954d9adce6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:51.404814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:51.405764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:51.406577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 187/388] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:51.414225 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d0e95-d9e1-4483-8555-4954d9adce6b None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:51.445802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:51.494098 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af69d3-c2d1-4d74-99fb-365fb76ca84f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:51.497358 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:51.550930 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6959694-490f-49aa-96c1-8478c90ec242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:51.551893 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6959694-490f-49aa-96c1-8478c90ec242 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.552321 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6959694-490f-49aa-96c1-8478c90ec242 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.552781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6959694-490f-49aa-96c1-8478c90ec242 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.554086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6959694-490f-49aa-96c1-8478c90ec242 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:51.555858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6959694-490f-49aa-96c1-8478c90ec242 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:51.557990 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 202/389] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:51 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:51.559389 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed4b2-4705-4961-985f-0e456956be36 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.559858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed4b2-4705-4961-985f-0e456956be36 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.560310 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ed4b2-4705-4961-985f-0e456956be36 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.561919 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 203/390] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:51.563677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ed4b2-4705-4961-985f-0e456956be36 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:51.580956 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d0e95-d9e1-4483-8555-4954d9adce6b None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:51.619363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae984464-848b-49f0-a4ec-534fc96ba87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:51.620277 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984464-848b-49f0-a4ec-534fc96ba87a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.620737 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984464-848b-49f0-a4ec-534fc96ba87a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.621215 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984464-848b-49f0-a4ec-534fc96ba87a None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.622187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae984464-848b-49f0-a4ec-534fc96ba87a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:51.622691 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae984464-848b-49f0-a4ec-534fc96ba87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:51.624282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae984464-848b-49f0-a4ec-534fc96ba87a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:51.634076 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 188/391] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:51.635572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fb1b-52a3-4549-aa83-1082bf9a694c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.635988 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fb1b-52a3-4549-aa83-1082bf9a694c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.636392 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179fb1b-52a3-4549-aa83-1082bf9a694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.655139 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-3179fb1b-52a3-4549-aa83-1082bf9a694c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:51.656534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-3179fb1b-52a3-4549-aa83-1082bf9a694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:51.685990 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ed4b2-4705-4961-985f-0e456956be36 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:51.733823 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 189/392] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:51.734675 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179fb1b-52a3-4549-aa83-1082bf9a694c None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:51.739131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d7b4d-42c3-45b1-b9fb-b8725aabf856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:51.740390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7b4d-42c3-45b1-b9fb-b8725aabf856 None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.740841 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7b4d-42c3-45b1-b9fb-b8725aabf856 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.741262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d7b4d-42c3-45b1-b9fb-b8725aabf856 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1/groups/ab6aff42ff2d4647bae190a931d580b1/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.744823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d7b4d-42c3-45b1-b9fb-b8725aabf856 None admin] RBAC: Authorizing `identity:create_grant(project_id=4604492596b94e1c8672d5c858d714f1, group_id=ab6aff42ff2d4647bae190a931d580b1, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:51.747134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d7b4d-42c3-45b1-b9fb-b8725aabf856 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:51.776586 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:51.846785 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 204/393] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Aug 19 17:48:51 2022] PUT /identity/v3/projects/4604492596b94e1c8672d5c858d714f1/groups/ab6aff42ff2d4647bae190a931d580b1/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:48:51.850933 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179fb1b-52a3-4549-aa83-1082bf9a694c None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:51.895788 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f519e5-18f6-4592-9ae1-f961b49a3a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:51.896460 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f519e5-18f6-4592-9ae1-f961b49a3a4a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:51.896735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f519e5-18f6-4592-9ae1-f961b49a3a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:51.897059 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f519e5-18f6-4592-9ae1-f961b49a3a4a None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:51.898336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f519e5-18f6-4592-9ae1-f961b49a3a4a None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:51.900234 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f519e5-18f6-4592-9ae1-f961b49a3a4a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:51.902075 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 190/394] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:51 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:51.907673 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d7b4d-42c3-45b1-b9fb-b8725aabf856 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:51.913647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:52.041103 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d7b4d-42c3-45b1-b9fb-b8725aabf856 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:52.077458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79342b9f-22d3-44f1-b423-7ccabc5a8050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:52.078471 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342b9f-22d3-44f1-b423-7ccabc5a8050 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.078954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342b9f-22d3-44f1-b423-7ccabc5a8050 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.079454 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79342b9f-22d3-44f1-b423-7ccabc5a8050 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.080798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79342b9f-22d3-44f1-b423-7ccabc5a8050 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:52.082481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79342b9f-22d3-44f1-b423-7ccabc5a8050 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:52.084322 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 205/395] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:51 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:52.090678 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f519e5-18f6-4592-9ae1-f961b49a3a4a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:52.102841 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79342b9f-22d3-44f1-b423-7ccabc5a8050 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:52.188044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:52.219176 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79342b9f-22d3-44f1-b423-7ccabc5a8050 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:52.236273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f519e5-18f6-4592-9ae1-f961b49a3a4a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:52.238420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:52.260458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3fcf-8ba7-4d7e-a6ef-bdbcf854fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:52.261134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3fcf-8ba7-4d7e-a6ef-bdbcf854fd52 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.261440 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3fcf-8ba7-4d7e-a6ef-bdbcf854fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.261725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b3fcf-8ba7-4d7e-a6ef-bdbcf854fd52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.272667 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b3fcf-8ba7-4d7e-a6ef-bdbcf854fd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-171b3fcf-8ba7-4d7e-a6ef-bdbcf854fd52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:52.278599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:52.279524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:52.280397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 206/396] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:52.285887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3fcf-8ba7-4d7e-a6ef-bdbcf854fd52 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:52.286504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a46824-f8a0-4f8f-ad9c-a0582d996591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:52.287280 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a46824-f8a0-4f8f-ad9c-a0582d996591 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.287661 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a46824-f8a0-4f8f-ad9c-a0582d996591 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.287983 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a46824-f8a0-4f8f-ad9c-a0582d996591 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1/groups/ab6aff42ff2d4647bae190a931d580b1/roles/0e16d3dcd8e045fe89150feef6d93543` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.291202 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a46824-f8a0-4f8f-ad9c-a0582d996591 None admin] RBAC: Authorizing `identity:create_grant(project_id=4604492596b94e1c8672d5c858d714f1, group_id=ab6aff42ff2d4647bae190a931d580b1, role_id=0e16d3dcd8e045fe89150feef6d93543)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:52.292621 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a46824-f8a0-4f8f-ad9c-a0582d996591 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:52.369801 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 191/397] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Aug 19 17:48:52 2022] PUT /identity/v3/projects/4604492596b94e1c8672d5c858d714f1/groups/ab6aff42ff2d4647bae190a931d580b1/roles/0e16d3dcd8e045fe89150feef6d93543 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:52.413377 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b3fcf-8ba7-4d7e-a6ef-bdbcf854fd52 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:52.432559 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9941-76d4-4ea7-9ed1-e807df758657 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.432869 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9941-76d4-4ea7-9ed1-e807df758657 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.433121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e9941-76d4-4ea7-9ed1-e807df758657 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.434858 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 192/398] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:52.441270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e15a1-ab87-475a-8695-c96ee627b184 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.441854 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e15a1-ab87-475a-8695-c96ee627b184 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.442344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e15a1-ab87-475a-8695-c96ee627b184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.458648 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:52.469452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:52.469452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.469452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.469452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.469870 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:52.469870 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:52.470671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:52.482455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-496e15a1-ab87-475a-8695-c96ee627b184 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:52.489624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-496e15a1-ab87-475a-8695-c96ee627b184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:52.489767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 207/399] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:52.500232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:52.641830 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 193/400] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:52.668984 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfd50e-a8a4-4538-8754-1ef9da12e3f1 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:52.709945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eccde3-6d9a-4eeb-a228-9e968d549ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:52.710605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eccde3-6d9a-4eeb-a228-9e968d549ac3 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.710894 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eccde3-6d9a-4eeb-a228-9e968d549ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.711164 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eccde3-6d9a-4eeb-a228-9e968d549ac3 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.712549 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eccde3-6d9a-4eeb-a228-9e968d549ac3 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:52.714026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eccde3-6d9a-4eeb-a228-9e968d549ac3 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:52.715816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 208/401] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:52 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:52.718286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b500-456a-4fdd-895c-61cc966143e0 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.718805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b500-456a-4fdd-895c-61cc966143e0 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.719267 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b500-456a-4fdd-895c-61cc966143e0 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.720832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eccde3-6d9a-4eeb-a228-9e968d549ac3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:52.721510 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 194/402] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:52.727731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed91b-f63f-4a84-bcbd-7f5c0f16f9be None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.728323 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed91b-f63f-4a84-bcbd-7f5c0f16f9be None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.728789 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed91b-f63f-4a84-bcbd-7f5c0f16f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.747992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-3c1ed91b-f63f-4a84-bcbd-7f5c0f16f9be None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:52.749535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-3c1ed91b-f63f-4a84-bcbd-7f5c0f16f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:52.802764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:52.824677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 195/403] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:52.844387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eccde3-6d9a-4eeb-a228-9e968d549ac3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:52.880177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5314c7-07cc-4d3b-bf44-f92b64724375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:52.885457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5314c7-07cc-4d3b-bf44-f92b64724375 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:52.885457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5314c7-07cc-4d3b-bf44-f92b64724375 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:52.885457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5314c7-07cc-4d3b-bf44-f92b64724375 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:52.885457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5314c7-07cc-4d3b-bf44-f92b64724375 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:52.885457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5314c7-07cc-4d3b-bf44-f92b64724375 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:52.885927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 209/404] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:52 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:52.896089 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed91b-f63f-4a84-bcbd-7f5c0f16f9be None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:52.923134 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:53.001107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed91b-f63f-4a84-bcbd-7f5c0f16f9be None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.035818 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e7b50-0d77-46bf-8ccb-2e17dfc7c744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:53.036477 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7b50-0d77-46bf-8ccb-2e17dfc7c744 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:53.036752 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7b50-0d77-46bf-8ccb-2e17dfc7c744 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:53.037022 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e7b50-0d77-46bf-8ccb-2e17dfc7c744 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac/groups/ab6aff42ff2d4647bae190a931d580b1/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:53.039636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e7b50-0d77-46bf-8ccb-2e17dfc7c744 None admin] RBAC: Authorizing `identity:create_grant(project_id=a92fe046f9574126b7da24bbab315fac, group_id=ab6aff42ff2d4647bae190a931d580b1, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:53.041076 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e7b50-0d77-46bf-8ccb-2e17dfc7c744 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:53.056820 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5314c7-07cc-4d3b-bf44-f92b64724375 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:53.169802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5314c7-07cc-4d3b-bf44-f92b64724375 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.188904 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 196/405] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Aug 19 17:48:52 2022] PUT /identity/v3/projects/a92fe046f9574126b7da24bbab315fac/groups/ab6aff42ff2d4647bae190a931d580b1/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:53.208784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:53.216381 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856817-cebf-4cd7-8903-e40b220cef29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:53.217461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856817-cebf-4cd7-8903-e40b220cef29 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:53.217747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856817-cebf-4cd7-8903-e40b220cef29 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:53.218061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856817-cebf-4cd7-8903-e40b220cef29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:53.232574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856817-cebf-4cd7-8903-e40b220cef29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-92856817-cebf-4cd7-8903-e40b220cef29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:53.237396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:53.238311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:53.239118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 210/406] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:53.245301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e7b50-0d77-46bf-8ccb-2e17dfc7c744 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:53.270870 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856817-cebf-4cd7-8903-e40b220cef29 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:53.378692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:53.400820 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e7b50-0d77-46bf-8ccb-2e17dfc7c744 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.440900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:53.441610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:53.441889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:53.442160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:53.442831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:53.443134 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:53.444656 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:53.455072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 197/407] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:53.460568 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:53.487271 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856817-cebf-4cd7-8903-e40b220cef29 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.526862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871b64-4b1b-45a1-b47d-68c4adbf6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:53.527502 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871b64-4b1b-45a1-b47d-68c4adbf6e23 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:53.527783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871b64-4b1b-45a1-b47d-68c4adbf6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:53.528057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871b64-4b1b-45a1-b47d-68c4adbf6e23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:53.539154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871b64-4b1b-45a1-b47d-68c4adbf6e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-93871b64-4b1b-45a1-b47d-68c4adbf6e23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:53.544331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:53.545229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:53.546074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 211/408] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:53.554238 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871b64-4b1b-45a1-b47d-68c4adbf6e23 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:53.582003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd034a-d4f3-4ef0-8ae1-fd5b98e9a7e2 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.609583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:53.618711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944662c-0bb4-4eac-a58a-fb42f3883f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:53.623437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944662c-0bb4-4eac-a58a-fb42f3883f12 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:53.623437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944662c-0bb4-4eac-a58a-fb42f3883f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:53.623437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944662c-0bb4-4eac-a58a-fb42f3883f12 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:53.623437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944662c-0bb4-4eac-a58a-fb42f3883f12 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:53.624357 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944662c-0bb4-4eac-a58a-fb42f3883f12 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:53.626308 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 198/409] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:53 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:53.632989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944662c-0bb4-4eac-a58a-fb42f3883f12 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:53.653455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:53.668449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871b64-4b1b-45a1-b47d-68c4adbf6e23 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.704417 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:53.705058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:53.705427 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:53.705792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:53.706525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:53.706899 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:53.708346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:53.718417 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 212/410] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:53.733784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:53.761943 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944662c-0bb4-4eac-a58a-fb42f3883f12 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.801083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a7381-c689-43e4-bd7e-870a7851936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:53.801724 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7381-c689-43e4-bd7e-870a7851936c None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:53.801999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7381-c689-43e4-bd7e-870a7851936c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:53.802602 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7381-c689-43e4-bd7e-870a7851936c None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:53.803937 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a7381-c689-43e4-bd7e-870a7851936c None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:53.806084 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a7381-c689-43e4-bd7e-870a7851936c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:53.807996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 199/411] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:53 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:53.814146 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a7381-c689-43e4-bd7e-870a7851936c None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:53.907548 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:53.935545 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a7381-c689-43e4-bd7e-870a7851936c None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.974867 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ae41-77f9-43a2-a48a-7ff20e780975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:53.975514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ae41-77f9-43a2-a48a-7ff20e780975 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:53.975795 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ae41-77f9-43a2-a48a-7ff20e780975 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:53.976073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1ae41-77f9-43a2-a48a-7ff20e780975 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac/groups/ab6aff42ff2d4647bae190a931d580b1/roles/0e16d3dcd8e045fe89150feef6d93543` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:53.978921 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ae41-77f9-43a2-a48a-7ff20e780975 None admin] RBAC: Authorizing `identity:create_grant(project_id=a92fe046f9574126b7da24bbab315fac, group_id=ab6aff42ff2d4647bae190a931d580b1, role_id=0e16d3dcd8e045fe89150feef6d93543)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:53.980371 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1ae41-77f9-43a2-a48a-7ff20e780975 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:53.982997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa321ce8-2421-45fd-b2b4-383b39f83598 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:53.994165 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:54.018325 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f22400-812f-4bc3-9964-87d919b58e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:54.019047 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f22400-812f-4bc3-9964-87d919b58e29 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:54.019332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f22400-812f-4bc3-9964-87d919b58e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:54.019610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f22400-812f-4bc3-9964-87d919b58e29 None admin] PATH_INFO: `/v3/groups/841a51088cf54b08a58c7c784a426996` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:54.020872 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f22400-812f-4bc3-9964-87d919b58e29 None admin] RBAC: Authorizing `identity:get_group(group_id=841a51088cf54b08a58c7c784a426996)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:54.022484 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f22400-812f-4bc3-9964-87d919b58e29 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:54.025399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 213/412] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:53 2022] GET /identity/v3/groups/841a51088cf54b08a58c7c784a426996 => generated 229 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:54.031443 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f22400-812f-4bc3-9964-87d919b58e29 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:54.068754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 200/413] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Aug 19 17:48:53 2022] PUT /identity/v3/projects/a92fe046f9574126b7da24bbab315fac/groups/ab6aff42ff2d4647bae190a931d580b1/roles/0e16d3dcd8e045fe89150feef6d93543 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 17:48:54.146324 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f22400-812f-4bc3-9964-87d919b58e29 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:54.183425 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eca9a-fdd2-43e6-8248-8dfcd2b14a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:54.184141 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eca9a-fdd2-43e6-8248-8dfcd2b14a31 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:54.184477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eca9a-fdd2-43e6-8248-8dfcd2b14a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:54.184757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eca9a-fdd2-43e6-8248-8dfcd2b14a31 None admin] PATH_INFO: `/v3/projects/36dbac3e54734453afe30db9d0d35548` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:54.186041 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eca9a-fdd2-43e6-8248-8dfcd2b14a31 None admin] RBAC: Authorizing `identity:get_project(project_id=36dbac3e54734453afe30db9d0d35548)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:54.187528 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eca9a-fdd2-43e6-8248-8dfcd2b14a31 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:54.189738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 214/414] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:54 2022] GET /identity/v3/projects/36dbac3e54734453afe30db9d0d35548 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:54.198908 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ae41-77f9-43a2-a48a-7ff20e780975 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:54.324535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1ae41-77f9-43a2-a48a-7ff20e780975 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:54.374176 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fed68-82e6-4229-a626-b5e1fd61f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:54.374861 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fed68-82e6-4229-a626-b5e1fd61f559 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:54.375138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fed68-82e6-4229-a626-b5e1fd61f559 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:54.375408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fed68-82e6-4229-a626-b5e1fd61f559 None admin] PATH_INFO: `/v3/projects/36dbac3e54734453afe30db9d0d35548/groups/841a51088cf54b08a58c7c784a426996/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:54.377366 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fed68-82e6-4229-a626-b5e1fd61f559 None admin] RBAC: Authorizing `identity:create_grant(project_id=36dbac3e54734453afe30db9d0d35548, group_id=841a51088cf54b08a58c7c784a426996, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:54.378832 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fed68-82e6-4229-a626-b5e1fd61f559 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:54.461506 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:54.467396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 201/415] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Aug 19 17:48:54 2022] PUT /identity/v3/projects/36dbac3e54734453afe30db9d0d35548/groups/841a51088cf54b08a58c7c784a426996/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:48:54.502893 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5a12e-29e2-41a1-9265-597e2af8110d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:54.503514 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5a12e-29e2-41a1-9265-597e2af8110d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:54.503991 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5a12e-29e2-41a1-9265-597e2af8110d None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:54.505554 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 215/416] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:54.511114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fc23-7f6b-47f2-90b3-86df5f877c47 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:54.511869 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fc23-7f6b-47f2-90b3-86df5f877c47 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:54.516889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fc23-7f6b-47f2-90b3-86df5f877c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:54.541180 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-eeb5fc23-7f6b-47f2-90b3-86df5f877c47 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:54.542764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-eeb5fc23-7f6b-47f2-90b3-86df5f877c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:54.629403 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 202/417] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:54.999819 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5a12e-29e2-41a1-9265-597e2af8110d None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:55.073798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:55.155058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5a12e-29e2-41a1-9265-597e2af8110d None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:55.199713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4d175-659b-469e-9ca5-631df09e4714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:55.200765 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4d175-659b-469e-9ca5-631df09e4714 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:55.201308 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4d175-659b-469e-9ca5-631df09e4714 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:55.201828 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4d175-659b-469e-9ca5-631df09e4714 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:55.222620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4d175-659b-469e-9ca5-631df09e4714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-d2f4d175-659b-469e-9ca5-631df09e4714 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:55.228287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:55.229191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:55.230026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 216/418] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:55.236895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5fc23-7f6b-47f2-90b3-86df5f877c47 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:55.359032 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5fc23-7f6b-47f2-90b3-86df5f877c47 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:55.363110 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf952d-1f55-4081-a0af-50f958fe1b04 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:55.363379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf952d-1f55-4081-a0af-50f958fe1b04 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:55.363653 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf952d-1f55-4081-a0af-50f958fe1b04 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:55.365110 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 217/419] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:55.370188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30730-5652-4b8d-877e-6089ca49d6a9 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:55.370475 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30730-5652-4b8d-877e-6089ca49d6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:55.373402 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f30730-5652-4b8d-877e-6089ca49d6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:55.389105 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-18f30730-5652-4b8d-877e-6089ca49d6a9 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:55.390505 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-18f30730-5652-4b8d-877e-6089ca49d6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:55.416052 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:55.426433 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:55.427105 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:55.427386 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:55.427655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:55.428336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] RBAC: Adding query filter params (name=member) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:55.428627 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:55.430256 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:55.451282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 203/420] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:55.457905 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:55.503707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 218/421] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:55.620755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04206393-bf84-46d2-b833-980482c6f936 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:55.670312 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c78f24-cf72-4633-9ca9-189f9185efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:55.670958 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78f24-cf72-4633-9ca9-189f9185efb3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:55.671287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78f24-cf72-4633-9ca9-189f9185efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:55.671565 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78f24-cf72-4633-9ca9-189f9185efb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:55.752549 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:55.763034 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c78f24-cf72-4633-9ca9-189f9185efb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:55.764706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c78f24-cf72-4633-9ca9-189f9185efb3 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:55.871985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 204/422] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:55.878609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f30730-5652-4b8d-877e-6089ca49d6a9 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:55.902123 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c78f24-cf72-4633-9ca9-189f9185efb3 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:55.954511 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:56.030083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:56.036277 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c78f24-cf72-4633-9ca9-189f9185efb3 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:56.055905 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f30730-5652-4b8d-877e-6089ca49d6a9 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:56.072840 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73625481-3b20-4822-91ba-c84789d7b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:56.074165 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73625481-3b20-4822-91ba-c84789d7b982 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.074584 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73625481-3b20-4822-91ba-c84789d7b982 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.075174 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73625481-3b20-4822-91ba-c84789d7b982 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.089527 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73625481-3b20-4822-91ba-c84789d7b982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:56.094010 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee3ead-fbc2-4998-b439-1b867fa79c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:56.094909 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3ead-fbc2-4998-b439-1b867fa79c18 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-73625481-3b20-4822-91ba-c84789d7b982 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:56.095125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:56.095987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:56.096786 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 205/423] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:48:56.097574 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7733-41e0-40d8-9f8d-8cd8aa20bb23 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.097703 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7733-41e0-40d8-9f8d-8cd8aa20bb23 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.098108 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7733-41e0-40d8-9f8d-8cd8aa20bb23 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.098620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3ead-fbc2-4998-b439-1b867fa79c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.098994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee3ead-fbc2-4998-b439-1b867fa79c18 None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.100156 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 206/424] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:56.102106 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7733-41e0-40d8-9f8d-8cd8aa20bb23 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:56.104312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee3ead-fbc2-4998-b439-1b867fa79c18 None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:56.106059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee3ead-fbc2-4998-b439-1b867fa79c18 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:56.108239 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 219/425] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:55 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:56.109632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72470a32-0d02-4dd0-9227-4b1e6be1ce16 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.110103 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72470a32-0d02-4dd0-9227-4b1e6be1ce16 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.110561 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72470a32-0d02-4dd0-9227-4b1e6be1ce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.130468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-72470a32-0d02-4dd0-9227-4b1e6be1ce16 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:56.132064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-72470a32-0d02-4dd0-9227-4b1e6be1ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:56.208593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 220/426] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:56.209878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72470a32-0d02-4dd0-9227-4b1e6be1ce16 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:56.243455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7733-41e0-40d8-9f8d-8cd8aa20bb23 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:56.251036 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:56.280899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:56.282560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.282560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.282560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.283544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:56.284262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:56.286157 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:56.301403 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 207/427] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:56.308534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:56.333290 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:56.366649 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72470a32-0d02-4dd0-9227-4b1e6be1ce16 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:56.433083 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d723-5d74-4d11-8844-e9fe403f2b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:56.433720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d723-5d74-4d11-8844-e9fe403f2b10 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.434009 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d723-5d74-4d11-8844-e9fe403f2b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.434334 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353d723-5d74-4d11-8844-e9fe403f2b10 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.436692 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d723-5d74-4d11-8844-e9fe403f2b10 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:56.439157 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353d723-5d74-4d11-8844-e9fe403f2b10 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:56.440733 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 221/428] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:56 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:56.447979 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d723-5d74-4d11-8844-e9fe403f2b10 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:56.468540 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180845c-2234-4003-a4e7-0eabc7a7272f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:56.535144 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a410f-b5a6-4cfa-adec-f8755877313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:56.535765 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a410f-b5a6-4cfa-adec-f8755877313e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.536050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a410f-b5a6-4cfa-adec-f8755877313e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.536323 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a410f-b5a6-4cfa-adec-f8755877313e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.604452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353d723-5d74-4d11-8844-e9fe403f2b10 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:56.609055 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:56.672662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:56.673702 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.674177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.674623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.676042 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a410f-b5a6-4cfa-adec-f8755877313e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:56.676397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] RBAC: Adding query filter params (group.id=ab6aff42ff2d4647bae190a931d580b1, role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=4604492596b94e1c8672d5c858d714f1) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:56.676878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:56.677715 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a410f-b5a6-4cfa-adec-f8755877313e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:56.678682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:56.700028 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 222/429] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:56 2022] GET /identity/v3/role_assignments?group.id=ab6aff42ff2d4647bae190a931d580b1&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:56.700028 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:56.700298 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:56.792698 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 208/430] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 17:48:56.798655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a410f-b5a6-4cfa-adec-f8755877313e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:56.896552 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea40002-5c7f-4936-9092-d3d372ca4cde None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:56.911923 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a410f-b5a6-4cfa-adec-f8755877313e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:56.941886 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:56.957838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88332-05e2-4657-8cab-02dd40654e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:56.958880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88332-05e2-4657-8cab-02dd40654e5a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.959359 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88332-05e2-4657-8cab-02dd40654e5a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.959852 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd88332-05e2-4657-8cab-02dd40654e5a None admin] PATH_INFO: `/v3/projects/4604492596b94e1c8672d5c858d714f1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:56.961872 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd88332-05e2-4657-8cab-02dd40654e5a None admin] RBAC: Authorizing `identity:get_project(project_id=4604492596b94e1c8672d5c858d714f1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:56.963621 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd88332-05e2-4657-8cab-02dd40654e5a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:56.966007 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 209/431] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:56 2022] GET /identity/v3/projects/4604492596b94e1c8672d5c858d714f1 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:56.971234 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88332-05e2-4657-8cab-02dd40654e5a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:56.977744 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9380f8c-b122-42d1-b131-ffe395a18254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:56.978738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9380f8c-b122-42d1-b131-ffe395a18254 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:56.981045 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9380f8c-b122-42d1-b131-ffe395a18254 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:56.981603 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9380f8c-b122-42d1-b131-ffe395a18254 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.007599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9380f8c-b122-42d1-b131-ffe395a18254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-c9380f8c-b122-42d1-b131-ffe395a18254 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:57.017877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:57.018876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:57.019676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 223/432] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:57.025665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9380f8c-b122-42d1-b131-ffe395a18254 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:57.079373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:57.118800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd88332-05e2-4657-8cab-02dd40654e5a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:57.160116 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcdd20-13b0-48f0-b6c8-dccb574a856c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:57.161158 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcdd20-13b0-48f0-b6c8-dccb574a856c None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.161655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcdd20-13b0-48f0-b6c8-dccb574a856c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.162162 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcdd20-13b0-48f0-b6c8-dccb574a856c None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.163425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcdd20-13b0-48f0-b6c8-dccb574a856c None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:57.165601 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcdd20-13b0-48f0-b6c8-dccb574a856c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:57.167677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 210/433] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:56 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:57.168922 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d19016-c26a-4d02-89cf-1a2605b49d92 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.169204 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d19016-c26a-4d02-89cf-1a2605b49d92 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.169498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d19016-c26a-4d02-89cf-1a2605b49d92 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.170877 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 211/434] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:57.174410 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d19016-c26a-4d02-89cf-1a2605b49d92 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:57.180589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9380f8c-b122-42d1-b131-ffe395a18254 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:57.233676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9413b-b836-4e75-9871-c9a34b12b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:57.234705 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9413b-b836-4e75-9871-c9a34b12b158 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.234983 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9413b-b836-4e75-9871-c9a34b12b158 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.235252 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9413b-b836-4e75-9871-c9a34b12b158 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.235981 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9413b-b836-4e75-9871-c9a34b12b158 None admin] RBAC: Adding query filter params (name=member) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:57.236279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9413b-b836-4e75-9871-c9a34b12b158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:57.238520 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9413b-b836-4e75-9871-c9a34b12b158 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:57.243284 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:57.248572 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 224/435] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:48:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:57.254474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b384-88e9-4c92-acff-79643ffc33d6 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.254764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b384-88e9-4c92-acff-79643ffc33d6 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.255036 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b384-88e9-4c92-acff-79643ffc33d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.278904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-8b21b384-88e9-4c92-acff-79643ffc33d6 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:57.280395 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-8b21b384-88e9-4c92-acff-79643ffc33d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:57.311120 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d19016-c26a-4d02-89cf-1a2605b49d92 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:57.351169 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:57.355299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.355299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.355299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.355299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] RBAC: Adding query filter params (group.id=ab6aff42ff2d4647bae190a931d580b1, role.id=0e16d3dcd8e045fe89150feef6d93543, scope.project.id=4604492596b94e1c8672d5c858d714f1) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:57.355299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:57.355652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:57.363799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 212/436] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:57 2022] GET /identity/v3/role_assignments?group.id=ab6aff42ff2d4647bae190a931d580b1&scope.project.id=4604492596b94e1c8672d5c858d714f1&role.id=0e16d3dcd8e045fe89150feef6d93543 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:57.364885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:57.369223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 225/437] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:48:57.370504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2889-f0a2-4020-8643-f607d0285089 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.370787 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2889-f0a2-4020-8643-f607d0285089 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.371058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2889-f0a2-4020-8643-f607d0285089 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.372535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 226/438] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:48:57.377977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1345e-ea7b-4505-98bd-dafcd60e736b None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.378251 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1345e-ea7b-4505-98bd-dafcd60e736b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.378527 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1345e-ea7b-4505-98bd-dafcd60e736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.397348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-e5c1345e-ea7b-4505-98bd-dafcd60e736b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:48:57.398646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-e5c1345e-ea7b-4505-98bd-dafcd60e736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:48:57.430095 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:57.497764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca323-9191-4401-839b-4926a7bbe975 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:57.503709 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 227/439] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:48:57.522582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:57.547597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce3cbb-22eb-4db9-96e0-53cf189840ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:57.548515 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce3cbb-22eb-4db9-96e0-53cf189840ab None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.548936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce3cbb-22eb-4db9-96e0-53cf189840ab None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.549347 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce3cbb-22eb-4db9-96e0-53cf189840ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.626793 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce3cbb-22eb-4db9-96e0-53cf189840ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:57.628459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce3cbb-22eb-4db9-96e0-53cf189840ab None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:57.737257 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1345e-ea7b-4505-98bd-dafcd60e736b None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:57.739421 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 213/440] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:48:57.745708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce3cbb-22eb-4db9-96e0-53cf189840ab None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:57.767160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:57.873037 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1345e-ea7b-4505-98bd-dafcd60e736b None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:57.876224 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce3cbb-22eb-4db9-96e0-53cf189840ab None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:57.914583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0d13-9f33-4460-956f-a1566a646941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:57.915191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097181d-d08d-42d8-9a60-14afcbb49d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:57.915337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0d13-9f33-4460-956f-a1566a646941 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.915511 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0d13-9f33-4460-956f-a1566a646941 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.915782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0d13-9f33-4460-956f-a1566a646941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.915870 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097181d-d08d-42d8-9a60-14afcbb49d11 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:57.916087 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097181d-d08d-42d8-9a60-14afcbb49d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:57.916355 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097181d-d08d-42d8-9a60-14afcbb49d11 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:57.917538 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097181d-d08d-42d8-9a60-14afcbb49d11 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:57.919007 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097181d-d08d-42d8-9a60-14afcbb49d11 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:57.920709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 214/441] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:57 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:57.921497 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097181d-d08d-42d8-9a60-14afcbb49d11 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:57.927742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d0d13-9f33-4460-956f-a1566a646941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-2d2d0d13-9f33-4460-956f-a1566a646941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:57.933162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:57.939525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 228/442] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:48:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:57.940380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0d13-9f33-4460-956f-a1566a646941 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:57.946636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.007929 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.025707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097181d-d08d-42d8-9a60-14afcbb49d11 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.034875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0d13-9f33-4460-956f-a1566a646941 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.060929 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcac39d-88ef-47aa-a09a-b874319260eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.061602 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac39d-88ef-47aa-a09a-b874319260eb None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.061883 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac39d-88ef-47aa-a09a-b874319260eb None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.062159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcac39d-88ef-47aa-a09a-b874319260eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.068687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5642db-faae-460a-afdb-fa6002533442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.069308 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5642db-faae-460a-afdb-fa6002533442 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.069616 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5642db-faae-460a-afdb-fa6002533442 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.069892 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5642db-faae-460a-afdb-fa6002533442 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.071085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5642db-faae-460a-afdb-fa6002533442 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.072445 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcac39d-88ef-47aa-a09a-b874319260eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:48:58.072539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5642db-faae-460a-afdb-fa6002533442 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.074236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 229/443] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:57 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:58.074836 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5642db-faae-460a-afdb-fa6002533442 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-5dcac39d-88ef-47aa-a09a-b874319260eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:48:58.077390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:48:58.078474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:48:58.079309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 215/444] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:48:58.079974 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcac39d-88ef-47aa-a09a-b874319260eb None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.161949 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.183459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcac39d-88ef-47aa-a09a-b874319260eb None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.188285 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5642db-faae-460a-afdb-fa6002533442 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.223078 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.223489 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.223709 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.223987 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.224101 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.224258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.224345 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.224609 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.224909 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:58.225209 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.225315 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] RBAC: Adding query filter params (group.id=ab6aff42ff2d4647bae190a931d580b1, role.id=6126abc4720c4543854a6fd2ddfacbbf, scope.project.id=a92fe046f9574126b7da24bbab315fac) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:58.225653 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.227228 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.227599 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.233534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 216/445] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/role_assignments?group.id=ab6aff42ff2d4647bae190a931d580b1&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=6126abc4720c4543854a6fd2ddfacbbf => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:58.234313 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.239777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 230/446] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:58.240940 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.250776 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.359645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6917ca3-25bd-4938-8c49-0d79a553d40c None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.364265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318aa050-46e3-47b6-b855-82dd2a0d5bfc None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.400563 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.401191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.401501 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.401773 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.402446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:58.402753 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.402909 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aa740-b444-42ff-8a46-4174f83e5381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.403506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aa740-b444-42ff-8a46-4174f83e5381 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.403783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aa740-b444-42ff-8a46-4174f83e5381 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.404049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5aa740-b444-42ff-8a46-4174f83e5381 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.404157 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.414817 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 217/447] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:58.415318 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.420556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.478855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5aa740-b444-42ff-8a46-4174f83e5381 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.480475 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5aa740-b444-42ff-8a46-4174f83e5381 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.499794 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.539685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962b3c-fc73-4409-8e6c-d067016f71d5 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.577792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bd9e-785e-442e-bd65-48996cfbc14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.578413 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bd9e-785e-442e-bd65-48996cfbc14d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.578694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bd9e-785e-442e-bd65-48996cfbc14d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.578968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bd9e-785e-442e-bd65-48996cfbc14d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.610085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 231/448] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 17:48:58.616832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aa740-b444-42ff-8a46-4174f83e5381 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.664963 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7bd9e-785e-442e-bd65-48996cfbc14d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.666568 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7bd9e-785e-442e-bd65-48996cfbc14d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.671063 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.730742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5aa740-b444-42ff-8a46-4174f83e5381 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.732635 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.764581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689051-53ac-4d4c-9ccb-010734289918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.765207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689051-53ac-4d4c-9ccb-010734289918 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.765520 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689051-53ac-4d4c-9ccb-010734289918 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.765795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f689051-53ac-4d4c-9ccb-010734289918 None admin] PATH_INFO: `/v3/projects/a92fe046f9574126b7da24bbab315fac` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.766480 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 218/449] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 19 17:48:58.766923 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f689051-53ac-4d4c-9ccb-010734289918 None admin] RBAC: Authorizing `identity:get_project(project_id=a92fe046f9574126b7da24bbab315fac)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.768406 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f689051-53ac-4d4c-9ccb-010734289918 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.770162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 232/450] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/projects/a92fe046f9574126b7da24bbab315fac => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:58.774926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bd9e-785e-442e-bd65-48996cfbc14d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.775814 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689051-53ac-4d4c-9ccb-010734289918 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.874375 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bd9e-785e-442e-bd65-48996cfbc14d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.875128 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f689051-53ac-4d4c-9ccb-010734289918 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:58.882765 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:58.907640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54482d8c-a6fc-4411-bd1a-15fbe2c7b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.908293 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54482d8c-a6fc-4411-bd1a-15fbe2c7b93d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.908570 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54482d8c-a6fc-4411-bd1a-15fbe2c7b93d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.908730 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df51ce-6626-468f-a22b-579e2b44e2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:58.908834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54482d8c-a6fc-4411-bd1a-15fbe2c7b93d None admin] PATH_INFO: `/v3/projects/36dbac3e54734453afe30db9d0d35548` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.909326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df51ce-6626-468f-a22b-579e2b44e2c3 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:58.910045 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df51ce-6626-468f-a22b-579e2b44e2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:58.910329 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df51ce-6626-468f-a22b-579e2b44e2c3 None admin] PATH_INFO: `/v3/groups/ab6aff42ff2d4647bae190a931d580b1` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:58.910427 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54482d8c-a6fc-4411-bd1a-15fbe2c7b93d None admin] RBAC: Authorizing `identity:get_project(project_id=36dbac3e54734453afe30db9d0d35548)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.911797 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54482d8c-a6fc-4411-bd1a-15fbe2c7b93d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.911897 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df51ce-6626-468f-a22b-579e2b44e2c3 None admin] RBAC: Authorizing `identity:get_group(group_id=ab6aff42ff2d4647bae190a931d580b1)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:58.913474 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 219/451] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/projects/36dbac3e54734453afe30db9d0d35548 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:58.913600 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df51ce-6626-468f-a22b-579e2b44e2c3 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:58.920211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 233/452] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/groups/ab6aff42ff2d4647bae190a931d580b1 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:48:58.920338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54482d8c-a6fc-4411-bd1a-15fbe2c7b93d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.921130 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df51ce-6626-468f-a22b-579e2b44e2c3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:58.955257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:59.019932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54482d8c-a6fc-4411-bd1a-15fbe2c7b93d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:59.020512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df51ce-6626-468f-a22b-579e2b44e2c3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:59.053896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314660b-9edd-4994-a9ea-f62387f0c06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:59.055142 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314660b-9edd-4994-a9ea-f62387f0c06d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:59.055636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314660b-9edd-4994-a9ea-f62387f0c06d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:59.055868 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4a96e-78de-463b-95b4-070cef476e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:59.055972 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314660b-9edd-4994-a9ea-f62387f0c06d None admin] PATH_INFO: `/v3/groups/841a51088cf54b08a58c7c784a426996` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:59.056491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4a96e-78de-463b-95b4-070cef476e80 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:59.056770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4a96e-78de-463b-95b4-070cef476e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:59.057040 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4a96e-78de-463b-95b4-070cef476e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:59.057136 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314660b-9edd-4994-a9ea-f62387f0c06d None admin] RBAC: Authorizing `identity:get_group(group_id=841a51088cf54b08a58c7c784a426996)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:59.057791 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4a96e-78de-463b-95b4-070cef476e80 None admin] RBAC: Adding query filter params (group.id=ab6aff42ff2d4647bae190a931d580b1, role.id=0e16d3dcd8e045fe89150feef6d93543, scope.project.id=a92fe046f9574126b7da24bbab315fac) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:59.058101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4a96e-78de-463b-95b4-070cef476e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:59.058526 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314660b-9edd-4994-a9ea-f62387f0c06d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:59.059517 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4a96e-78de-463b-95b4-070cef476e80 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:59.060082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 220/453] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/groups/841a51088cf54b08a58c7c784a426996 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:59.065761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 234/454] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:58 2022] GET /identity/v3/role_assignments?group.id=ab6aff42ff2d4647bae190a931d580b1&scope.project.id=a92fe046f9574126b7da24bbab315fac&role.id=0e16d3dcd8e045fe89150feef6d93543 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:48:59.065969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314660b-9edd-4994-a9ea-f62387f0c06d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:48:59.173313 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314660b-9edd-4994-a9ea-f62387f0c06d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:48:59.176346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:48:59.210144 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85d50b-8689-4be8-966a-762757bbabcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:48:59.210848 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d50b-8689-4be8-966a-762757bbabcf None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:48:59.211195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d50b-8689-4be8-966a-762757bbabcf None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:48:59.211678 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d50b-8689-4be8-966a-762757bbabcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:48:59.212542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85d50b-8689-4be8-966a-762757bbabcf None admin] RBAC: Adding query filter params (group.id=841a51088cf54b08a58c7c784a426996, role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=36dbac3e54734453afe30db9d0d35548) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:48:59.213083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85d50b-8689-4be8-966a-762757bbabcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:48:59.215149 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85d50b-8689-4be8-966a-762757bbabcf None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:48:59.221598 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 221/455] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Aug 19 17:48:59 2022] GET /identity/v3/role_assignments?group.id=841a51088cf54b08a58c7c784a426996&scope.project.id=36dbac3e54734453afe30db9d0d35548&role.id=757702b4209942a3b2ec7bf21d995169 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:01.834924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7e44-d87b-4481-97db-f37da2163a8c None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:01.836015 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7e44-d87b-4481-97db-f37da2163a8c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:01.836557 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b7e44-d87b-4481-97db-f37da2163a8c None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:01.838234 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 235/456] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:01.844488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940d44-ad42-4070-9eba-e124166744d3 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:01.845065 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940d44-ad42-4070-9eba-e124166744d3 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:01.845065 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4940d44-ad42-4070-9eba-e124166744d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:01.864370 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d4940d44-ad42-4070-9eba-e124166744d3 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:01.865937 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d4940d44-ad42-4070-9eba-e124166744d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:01.957554 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 222/457] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:02.003214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5f15-df68-418d-b2fb-72471f4f0d5f None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.003685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5f15-df68-418d-b2fb-72471f4f0d5f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.004033 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c5f15-df68-418d-b2fb-72471f4f0d5f None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.006406 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 236/458] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:02.012899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bedc4f-0894-493f-8317-a41127aa1b68 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.013380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bedc4f-0894-493f-8317-a41127aa1b68 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.014030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bedc4f-0894-493f-8317-a41127aa1b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.036635 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-88bedc4f-0894-493f-8317-a41127aa1b68 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:02.038863 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-88bedc4f-0894-493f-8317-a41127aa1b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:02.129075 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 223/459] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:02.139539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1896b-5ce5-48cd-890b-f2ddb18df99a None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.139862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1896b-5ce5-48cd-890b-f2ddb18df99a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.140101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1896b-5ce5-48cd-890b-f2ddb18df99a None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.141461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 237/460] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:02.148595 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae135b1-e01e-46de-8332-ee7f75f479eb None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.148944 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae135b1-e01e-46de-8332-ee7f75f479eb None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.149150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae135b1-e01e-46de-8332-ee7f75f479eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.173737 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-9ae135b1-e01e-46de-8332-ee7f75f479eb None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:02.174944 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-9ae135b1-e01e-46de-8332-ee7f75f479eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:02.206329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:02.269554 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 224/461] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:02.344319 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1896b-5ce5-48cd-890b-f2ddb18df99a None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:02.388131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:02.394860 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5e240-e619-4c24-9b39-90e9570d1a75 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.395147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5e240-e619-4c24-9b39-90e9570d1a75 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.395421 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5e240-e619-4c24-9b39-90e9570d1a75 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.396816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 225/462] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:02.404177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2197f-c9cc-4dbd-8f2c-d3af1538f34a None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.404177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2197f-c9cc-4dbd-8f2c-d3af1538f34a None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.404177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2197f-c9cc-4dbd-8f2c-d3af1538f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.425735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-8cd2197f-c9cc-4dbd-8f2c-d3af1538f34a None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:02.426925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-8cd2197f-c9cc-4dbd-8f2c-d3af1538f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:02.463857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1896b-5ce5-48cd-890b-f2ddb18df99a None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:02.504029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:02.504657 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.504939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.505218 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.511011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 226/463] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:02.512080 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2197f-c9cc-4dbd-8f2c-d3af1538f34a None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:02.523982 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:02.526081 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:02.545003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:02.546018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:02.546901 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:02.546901 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:02.546901 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:02.553855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 238/464] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:02.555591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:02.607716 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:02.624647 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2197f-c9cc-4dbd-8f2c-d3af1538f34a None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:02.659240 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:02.662214 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:02.663158 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.663449 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.663723 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.669615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd6fb6-46b7-4712-b40c-c66e4cb22655 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:02.674104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:02.675561 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:02.690327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:02.691387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:02.692251 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:02.692251 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:02.692251 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:02.692251 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 227/465] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:02.692251 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:02.714216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:02.715086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.715504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.715925 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.716712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:02.717288 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:02.718769 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:02.743380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 239/466] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:02.743380 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:02.807081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6853c9-5662-4df1-a83e-f5fae70c6df4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:02.845077 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:02.845846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.846028 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.846305 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.855060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b62385-6b57-47a3-b08a-476756f2bd0c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:02.855579 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:02.858012 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:02.859837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:02.877081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:02.878070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:02.878914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:02.878914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:02.878914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:02.878914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 228/467] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:02.879137 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:02.893092 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:02.893739 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:02.894073 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:02.898018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:02.898018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:02.898018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:02.898018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:02.907887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 240/468] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:02.908861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:02.922936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:02.985260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30445cf3-a629-477b-9599-ca7bbace4f65 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:03.011868 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cd08b-4d00-413f-9682-c677532ec795 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:03.021478 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552d5e6-33e9-4d7d-85ac-8ba2b1f23efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:03.022400 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552d5e6-33e9-4d7d-85ac-8ba2b1f23efe None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:03.022840 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552d5e6-33e9-4d7d-85ac-8ba2b1f23efe None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:03.023121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552d5e6-33e9-4d7d-85ac-8ba2b1f23efe None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:03.023985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552d5e6-33e9-4d7d-85ac-8ba2b1f23efe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:03.025445 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552d5e6-33e9-4d7d-85ac-8ba2b1f23efe None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:03.044959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:03.045626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:03.050880 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:03.050880 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:03.057332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:03.058824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:03.073430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:03.074507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:03.075519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:03.075519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:03.075519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:03.075519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 241/469] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:03.075519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:03.116877 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 229/470] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:49:02 2022] POST /identity/v3/users => generated 246 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:03.118721 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552d5e6-33e9-4d7d-85ac-8ba2b1f23efe None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:03.139892 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:03.176638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:03.187517 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6ef0b-375e-4fef-af50-72cf49b0f9af None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:03.229466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:03.230431 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:03.230723 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:03.231140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:03.231980 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:03.232286 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:03.234566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:03.236131 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552d5e6-33e9-4d7d-85ac-8ba2b1f23efe None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:03.249458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 242/471] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:03.250620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:03.279128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54043c4-cbc9-45d8-af3e-41ac56dae70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:03.279757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54043c4-cbc9-45d8-af3e-41ac56dae70c None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:03.280033 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54043c4-cbc9-45d8-af3e-41ac56dae70c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:03.280301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54043c4-cbc9-45d8-af3e-41ac56dae70c None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:03.280942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54043c4-cbc9-45d8-af3e-41ac56dae70c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:03.282426 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54043c4-cbc9-45d8-af3e-41ac56dae70c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:03.358035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 230/472] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:49:03 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:03.359629 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54043c4-cbc9-45d8-af3e-41ac56dae70c None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:03.366004 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab6973-7191-42a2-9e7d-d584969fec03 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:03.400247 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:03.416419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:03.417509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:03.417802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:03.418112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:03.419109 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:03.419578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:03.421189 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:03.438143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 243/473] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:03.446662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:03.502663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54043c4-cbc9-45d8-af3e-41ac56dae70c None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:03.505672 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:03.544577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec4536-1fc2-4ea8-ad89-1661802febad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:03.545390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4536-1fc2-4ea8-ad89-1661802febad None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:03.545695 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4536-1fc2-4ea8-ad89-1661802febad None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:03.545981 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec4536-1fc2-4ea8-ad89-1661802febad None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:03.546638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec4536-1fc2-4ea8-ad89-1661802febad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:03.548110 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec4536-1fc2-4ea8-ad89-1661802febad None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:03.565719 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b19650-d6ad-4457-91ac-350b52154b36 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:03.603205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92c56d-060d-4b60-b65d-2eafadb4fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:03.603827 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92c56d-060d-4b60-b65d-2eafadb4fd6c None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:03.604132 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92c56d-060d-4b60-b65d-2eafadb4fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:03.604387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92c56d-060d-4b60-b65d-2eafadb4fd6c None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:03.605051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92c56d-060d-4b60-b65d-2eafadb4fd6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:03.606571 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92c56d-060d-4b60-b65d-2eafadb4fd6c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:03.667410 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 231/474] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:49:03 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:03.698945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 244/475] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:49:03 2022] POST /identity/v3/users => generated 249 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:05.437073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c387-ada6-49ba-b531-ebf516ec17b2 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:05.437653 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c387-ada6-49ba-b531-ebf516ec17b2 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:05.437653 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239c387-ada6-49ba-b531-ebf516ec17b2 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:05.439207 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 232/476] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:05.444929 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0772e7-fd43-43e4-97e7-ada4cf400b5c None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:05.445923 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0772e7-fd43-43e4-97e7-ada4cf400b5c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:05.446177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0772e7-fd43-43e4-97e7-ada4cf400b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:05.464512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-5c0772e7-fd43-43e4-97e7-ada4cf400b5c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:05.465751 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-5c0772e7-fd43-43e4-97e7-ada4cf400b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:05.499001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:05.540132 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 245/477] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:05.710847 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6f60-af62-40a4-8883-797efd98c8ab None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:05.711723 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6f60-af62-40a4-8883-797efd98c8ab None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:05.712097 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c6f60-af62-40a4-8883-797efd98c8ab None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:05.713901 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 233/478] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:05.722022 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e43266-864f-41ea-a0bf-647a8e149cb4 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:05.722423 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e43266-864f-41ea-a0bf-647a8e149cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:05.722805 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e43266-864f-41ea-a0bf-647a8e149cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:05.740972 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-31e43266-864f-41ea-a0bf-647a8e149cb4 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:05.742259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-31e43266-864f-41ea-a0bf-647a8e149cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:05.811698 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 246/479] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:05.880886 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c6f60-af62-40a4-8883-797efd98c8ab None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:05.990117 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c6f60-af62-40a4-8883-797efd98c8ab None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.013503 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204acc21-d0b0-4c9c-bd12-a0361e65a948 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.013781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204acc21-d0b0-4c9c-bd12-a0361e65a948 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.014009 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204acc21-d0b0-4c9c-bd12-a0361e65a948 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.015585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 247/480] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:06.020435 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db6f9-34cf-4de7-a355-46c1e7f2d9d0 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.020714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db6f9-34cf-4de7-a355-46c1e7f2d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.020983 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07db6f9-34cf-4de7-a355-46c1e7f2d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.030453 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff335f-66c2-455f-a534-a44093583ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.032815 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff335f-66c2-455f-a534-a44093583ec8 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.032815 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff335f-66c2-455f-a534-a44093583ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.032815 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff335f-66c2-455f-a534-a44093583ec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.041786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-f07db6f9-34cf-4de7-a355-46c1e7f2d9d0 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:06.042966 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-f07db6f9-34cf-4de7-a355-46c1e7f2d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:06.044239 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff335f-66c2-455f-a534-a44093583ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-54ff335f-66c2-455f-a534-a44093583ec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:06.051351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:06.052278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:06.053273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 234/481] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:06.059860 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c92c-fa50-4b1a-8159-2acfe1dff0b0 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.060142 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c92c-fa50-4b1a-8159-2acfe1dff0b0 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.060427 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c92c-fa50-4b1a-8159-2acfe1dff0b0 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.061724 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 235/482] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:49:06.066199 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c92c-fa50-4b1a-8159-2acfe1dff0b0 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.089872 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:06.121112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 248/483] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:06.121112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a41e-27d2-4150-a770-a56f72b0524c None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.121112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a41e-27d2-4150-a770-a56f72b0524c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.121112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853a41e-27d2-4150-a770-a56f72b0524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.143508 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-e853a41e-27d2-4150-a770-a56f72b0524c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:06.145187 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-e853a41e-27d2-4150-a770-a56f72b0524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:06.173812 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:06.186472 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c92c-fa50-4b1a-8159-2acfe1dff0b0 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.221961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 249/484] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:06.223066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853a41e-27d2-4150-a770-a56f72b0524c None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.230483 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.231783 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.232297 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.232772 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.234029 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:06.234583 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:06.236746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:06.252302 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 236/485] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:06.254040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.341342 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:06.344665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853a41e-27d2-4150-a770-a56f72b0524c None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.372603 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea4f29-9e94-4eed-b2c4-7dd266652a6d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.383928 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229550a5-857b-45e4-a660-0dcb4c10d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.384812 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229550a5-857b-45e4-a660-0dcb4c10d686 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.385292 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229550a5-857b-45e4-a660-0dcb4c10d686 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.385823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229550a5-857b-45e4-a660-0dcb4c10d686 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.397085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229550a5-857b-45e4-a660-0dcb4c10d686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-229550a5-857b-45e4-a660-0dcb4c10d686 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:06.402593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:06.403477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:06.404289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:06.407149 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 250/486] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:06.412742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229550a5-857b-45e4-a660-0dcb4c10d686 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.418044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.419494 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.419494 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.419494 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.431859 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:06.433330 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:06.438439 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:06.448611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:06.451153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:06.452000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:06.452000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:06.452000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:06.452000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 237/487] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:06.454390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.533733 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229550a5-857b-45e4-a660-0dcb4c10d686 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.568566 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20f757-77d1-47fb-81b3-c14c7eb95cf4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.571026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.571724 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.572004 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.572278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.572939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] RBAC: Adding query filter params (name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:06.573244 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:06.574657 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:06.582879 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 251/488] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:06.583758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.603296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61ed2-e6f4-446e-8866-4e847743a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.603926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61ed2-e6f4-446e-8866-4e847743a0f1 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.604293 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61ed2-e6f4-446e-8866-4e847743a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.604570 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61ed2-e6f4-446e-8866-4e847743a0f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.606423 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:06.615504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf61ed2-e6f4-446e-8866-4e847743a0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-ecf61ed2-e6f4-446e-8866-4e847743a0f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:06.621072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:06.622230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:06.623292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:06.626962 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 238/489] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:06.627784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61ed2-e6f4-446e-8866-4e847743a0f1 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.666077 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:06.685162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeec180-ce05-49a6-9c52-8fed90f72faa None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.719361 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.719971 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.720253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.720526 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.721163 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:06.721491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:06.722931 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:06.729102 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61ed2-e6f4-446e-8866-4e847743a0f1 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.734832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 252/490] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:06.735633 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.763739 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbe622-eac3-4419-be36-62bea6d1cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.764354 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe622-eac3-4419-be36-62bea6d1cd44 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.764630 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe622-eac3-4419-be36-62bea6d1cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.764900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbe622-eac3-4419-be36-62bea6d1cd44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.774755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbe622-eac3-4419-be36-62bea6d1cd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-c5dbe622-eac3-4419-be36-62bea6d1cd44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:06.779953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:06.781019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:06.781890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 239/491] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:06.782551 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbe622-eac3-4419-be36-62bea6d1cd44 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.837915 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:06.838102 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302a059-aacb-494a-ab58-423ad667c906 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.872448 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.873068 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.873348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.873692 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.881841 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:06.882380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbe622-eac3-4419-be36-62bea6d1cd44 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:06.884718 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:06.886253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:06.900455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:06.901540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:06.902398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:06.902398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:06.902398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:06.902398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 253/492] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:06.902398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:06.920007 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:06.920610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:06.920891 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:06.921165 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:06.921866 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:06.922169 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:06.923543 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:06.931856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 240/493] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:06.932638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.006855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1e5e5-7f63-474c-ab6d-ac6cadd7f3b2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.032414 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa7bbc-c2ae-4066-80f8-e456fffbf477 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.040642 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.041262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.041574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.041848 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.049191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.050084 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.050678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:07.063278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:07.072703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 254/494] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:07.073862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.074625 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.074625 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.074625 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.074625 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.074926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:07.074926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.074926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.080222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 241/495] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:07.081005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.119222 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.168279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8497cf-6283-4b2a-95b3-e320ae49b3fc None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.184988 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e2776-95e5-458d-9e8c-6753e0dd30eb None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.201901 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.202501 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.202776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.203057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.203676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:07.203976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.205347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.217341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 255/496] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:07.218280 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.219225 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.219845 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.220122 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.220393 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.231213 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.232681 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:07.247336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:07.248465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:07.249326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:07.249326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:07.249326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:07.249326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 242/497] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:07.249326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.281760 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.320485 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a3f54-239b-4b58-a2d1-c89666dbf662 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.333369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.353248 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d7caf-3060-4648-ad92-70486c00e541 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.355426 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.356293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.356409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.356615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.357462 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:07.357832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.359287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.386948 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.387496 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.387772 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.388041 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.396447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 256/498] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:07.397089 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.399421 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.400873 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:07.416383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:07.417440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:07.418306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:07.418306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:07.418306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:07.418306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 243/499] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:07.418306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.499402 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc7324-5bee-432c-9940-e102f58de251 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.506824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.525535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefd50-e28e-40eb-b91d-e2a5d91a0101 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.534374 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.535274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.535553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.535829 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.546430 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.548985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.558531 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.559130 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.559412 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.559688 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.560333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:07.560640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.562064 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:07.564553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:07.565390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 257/500] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:07.566357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.580192 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 244/501] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:07.581011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.599275 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.673201 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53ee4a-e5c2-4c42-a80a-87608887bb7b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.679352 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f293f2-4a2a-46fb-a1ac-9efc4abe6a11 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.707743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6ecb9-c5b6-4f9e-a78a-ef8d73a5f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.708349 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6ecb9-c5b6-4f9e-a78a-ef8d73a5f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.708632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6ecb9-c5b6-4f9e-a78a-ef8d73a5f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.708910 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6ecb9-c5b6-4f9e-a78a-ef8d73a5f9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.713539 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.714135 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.714413 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.714684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.715324 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:07.715627 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.717011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.728393 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 245/502] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:07.729189 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.732564 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.784652 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6ecb9-c5b6-4f9e-a78a-ef8d73a5f9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.786432 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6ecb9-c5b6-4f9e-a78a-ef8d73a5f9e8 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.814927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.829753 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e478eb-62cb-4c27-ba08-43d10c345a2a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:07.862686 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:07.863293 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:07.863571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:07.863864 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:07.864587 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:07.864891 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:07.866360 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:07.888146 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 258/503] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:07.889068 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6ecb9-c5b6-4f9e-a78a-ef8d73a5f9e8 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.905269 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 246/504] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:07.906190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:07.965005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:07.990670 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6ecb9-c5b6-4f9e-a78a-ef8d73a5f9e8 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.004197 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c7b3-b3e9-4a96-b923-3e2634456f54 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.020263 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.026738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.027392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.027735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.028050 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.034929 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.036619 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.039468 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.040093 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.040371 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.040646 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.047683 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:08.048337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:08.049392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:49:08.050393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:08.050987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.051065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 259/505] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:08.051065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:08.065159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:08.066272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 247/506] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:08.067488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.151899 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc3a11-82cf-45cd-9f1c-7d84c68f1d77 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.167666 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c2faf-43ef-4b0a-bcf2-0560ca5aaee3 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.185880 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.186504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.186776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.187042 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.187725 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.198448 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.199952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.201967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2a45d-dd6c-4069-9287-2304806aa860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.202567 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2a45d-dd6c-4069-9287-2304806aa860 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.202846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2a45d-dd6c-4069-9287-2304806aa860 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.203118 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2a45d-dd6c-4069-9287-2304806aa860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:08.214489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:08.215615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:08.216515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:08.216515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:08.216515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:08.216515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 260/507] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:08.216515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.259760 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.276520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2a45d-dd6c-4069-9287-2304806aa860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.278012 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2a45d-dd6c-4069-9287-2304806aa860 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.315350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36c1d7-683e-4d68-8006-050236622e9e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.348532 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.349135 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.349411 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.349712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.350426 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:08.350729 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.352489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.369536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 261/508] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:08.370336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.374827 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 248/509] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:08.375577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2a45d-dd6c-4069-9287-2304806aa860 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.396912 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.466566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.469383 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e7e5-8f00-4edf-8b8c-4f50deee5782 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.473391 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2a45d-dd6c-4069-9287-2304806aa860 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.504522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.505131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.505455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.505740 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.506460 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:08.506774 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.508271 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.511914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.512563 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.512841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.513106 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.513762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:08.514070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.515404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.525551 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 262/510] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:08.526371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.531104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 249/511] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:08.531104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.610028 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.628493 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775551e-7d58-495c-a4b8-b1f8d8419d0f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.629150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd2785-f7ad-4386-a536-dc7c2718191d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.662116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140108d-8230-484a-b2a0-41b3a62297d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.662709 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140108d-8230-484a-b2a0-41b3a62297d1 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.662974 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.663094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140108d-8230-484a-b2a0-41b3a62297d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.663238 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140108d-8230-484a-b2a0-41b3a62297d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.663600 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.663880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.664683 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.675171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.676615 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.690643 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:08.690994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:08.691898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:08.692746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:08.692746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:08.692746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:08.692746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 250/512] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:08.692958 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.736391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140108d-8230-484a-b2a0-41b3a62297d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.737802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140108d-8230-484a-b2a0-41b3a62297d1 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.793895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e31b6b-9a14-4c42-8e05-44954dc77546 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.822733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.827406 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953968bc-aab1-4198-b79d-5ef35018eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.828011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953968bc-aab1-4198-b79d-5ef35018eefe None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.828296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953968bc-aab1-4198-b79d-5ef35018eefe None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.828568 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953968bc-aab1-4198-b79d-5ef35018eefe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.835749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 263/513] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:08.837188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140108d-8230-484a-b2a0-41b3a62297d1 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:08.893914 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:08.897303 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953968bc-aab1-4198-b79d-5ef35018eefe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.899776 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953968bc-aab1-4198-b79d-5ef35018eefe None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.936150 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140108d-8230-484a-b2a0-41b3a62297d1 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:08.970177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:08.970800 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:08.971077 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:08.971347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:08.978857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:08.980328 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:08.992029 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:08.993540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 264/514] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:08.994399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.003158 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 251/515] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:09.003158 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953968bc-aab1-4198-b79d-5ef35018eefe None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.034032 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.096986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6ba8-27b3-4cdf-ba69-2c034584ad55 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.101672 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953968bc-aab1-4198-b79d-5ef35018eefe None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.115454 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.132333 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.133075 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.133499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.133818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.134482 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:09.134786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.135806 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.136158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.136428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.136706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.136975 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.146881 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.147775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 265/516] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:09.148333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.149094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:09.166991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:09.167965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:09.168812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:09.168812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:09.168812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:09.168812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 252/517] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:09.169229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.251783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c9c13-8950-42f9-863c-bd601ca1a516 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.253462 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.269043 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d6999-3726-48dc-9ab6-cd492184f190 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.286488 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.287178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.287727 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.288000 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.288679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:09.288986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.291087 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.302950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.303568 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.303843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.304111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.308977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 266/518] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:09.314003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.315437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.316892 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:09.330952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:09.331875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:09.332731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:09.332731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:09.332731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:09.332731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 253/519] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:09.333229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.355326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.415696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762909e-b747-48a9-9f8b-4a9026d67639 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.431906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e0b38-f147-4049-8c3c-80be5b0c61c8 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.449622 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.450275 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.450557 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.450828 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.457259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.458738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.465270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.465901 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.466186 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.466462 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.467096 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:09.467403 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.468758 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:09.469608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:09.470466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:09.471320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 267/520] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:09.471819 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.472618 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.491102 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 254/521] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:09.491102 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.573062 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.576404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e6b75-aa1c-4e66-aaf3-99c9d03d7219 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.589178 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5486c-d510-49d3-b5f1-0340864c91d5 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.610934 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.611559 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.611834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.612101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.612823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=cbf8fe29550b480dbb5294af4dc962c6) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:09.613130 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.614610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.627753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 268/522] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/role_assignments?user.id=cbf8fe29550b480dbb5294af4dc962c6&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:09.627753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.628073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.628073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.628073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.628073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.628401 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:09.628401 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.628401 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.645035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 255/523] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:09.645035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.711643 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.742175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423bf68-5787-48ea-af2c-a74248e156dc None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.761905 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd3685-3e8f-49d1-85db-9a62d0a3e4de None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.780604 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.781229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.781545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.781823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.782524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:09.782835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.784316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.799445 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 269/524] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:09.800094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.811158 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.811158 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.811414 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.811852 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.818831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.820279 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.827058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:09.833762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:09.841585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 256/525] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:09.842465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.919569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b075f0-f71a-4a03-8920-2507f655b7c2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.951017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4c5c8-fde5-4eb9-b52d-fdd10f408ad5 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:09.954315 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.954948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.955226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.955495 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.963348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.964814 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:09.967764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:09.975822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:09.983347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 270/526] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:09.984182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:09.994716 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:09.995489 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:09.995834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:09.996195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:09.996992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=2d52483e48804cbfad701d198deea470) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:09.997370 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:09.998849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:10.004915 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 257/527] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/role_assignments?user.id=2d52483e48804cbfad701d198deea470&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:10.006476 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:10.081570 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:10.103912 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd03116-5ab4-4b2f-bda9-a282792c1d4a None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:10.144983 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:10.146047 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:10.146537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:10.147053 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:10.147408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65e4b-e89d-49e0-b4c0-ba1a45688cb2 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:10.148195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:10.148744 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:10.150527 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:10.170617 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 271/528] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:10.176432 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:10.194823 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:10.195570 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:10.195877 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:10.196311 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:10.196983 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:10.197294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:10.198784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:10.223063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 258/529] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:10.224664 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:10.269294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:10.327446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dfcaeb-04fd-4c0f-a357-a45a2a48c985 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:10.334805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bd1e6-e785-465b-9e86-6d85200025c7 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:10.372167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfd0b4-89eb-4918-8203-5683a725883a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:10.373225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfd0b4-89eb-4918-8203-5683a725883a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:10.373822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfd0b4-89eb-4918-8203-5683a725883a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:10.374353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfd0b4-89eb-4918-8203-5683a725883a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:10.375524 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfd0b4-89eb-4918-8203-5683a725883a None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=b864fd056be54f2986135bbb77bdf7d2) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:10.376169 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfd0b4-89eb-4918-8203-5683a725883a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:10.376500 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8941b-3660-4d2d-adf1-49eabb948895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:10.377105 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8941b-3660-4d2d-adf1-49eabb948895 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:10.377384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8941b-3660-4d2d-adf1-49eabb948895 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:10.377693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8941b-3660-4d2d-adf1-49eabb948895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:10.378414 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8941b-3660-4d2d-adf1-49eabb948895 None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=7fb05df536de4b159101ffa5cc41c5ee) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:10.378725 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8941b-3660-4d2d-adf1-49eabb948895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:10.379112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfd0b4-89eb-4918-8203-5683a725883a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:10.380230 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8941b-3660-4d2d-adf1-49eabb948895 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:10.389832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 272/531] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:10 2022] GET /identity/v3/role_assignments?user.id=b864fd056be54f2986135bbb77bdf7d2&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:10.392810 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 259/531] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:10 2022] GET /identity/v3/role_assignments?user.id=7fb05df536de4b159101ffa5cc41c5ee&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:11.856834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6596d4-fec2-487f-87ff-5aea4b367d74 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:11.857329 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6596d4-fec2-487f-87ff-5aea4b367d74 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:11.857329 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6596d4-fec2-487f-87ff-5aea4b367d74 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:11.858938 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 273/532] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:11.864377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e557ace-0c43-4b82-a7ad-e2f720f49c8d None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:11.864762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e557ace-0c43-4b82-a7ad-e2f720f49c8d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:11.864944 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e557ace-0c43-4b82-a7ad-e2f720f49c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:11.885155 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-1e557ace-0c43-4b82-a7ad-e2f720f49c8d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:11.886395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-1e557ace-0c43-4b82-a7ad-e2f720f49c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:11.957164 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 260/533] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:12.280498 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aea9a-fc4d-4983-a243-223cf5dd6c09 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.280891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aea9a-fc4d-4983-a243-223cf5dd6c09 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.281070 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45aea9a-fc4d-4983-a243-223cf5dd6c09 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.282555 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 274/534] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:12.292294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8d33-970f-45ab-a937-70ce41ccec9e None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.292294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8d33-970f-45ab-a937-70ce41ccec9e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.292294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8d33-970f-45ab-a937-70ce41ccec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.295657 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aea9a-fc4d-4983-a243-223cf5dd6c09 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:12.304749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:12.310540 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-34ea8d33-970f-45ab-a937-70ce41ccec9e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:12.312058 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-34ea8d33-970f-45ab-a937-70ce41ccec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:12.341206 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:12.387335 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 261/535] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:12.412344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45aea9a-fc4d-4983-a243-223cf5dd6c09 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:12.447743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e305c1-76ae-4c9e-a5f8-5c3894817e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:12.448378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e305c1-76ae-4c9e-a5f8-5c3894817e87 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.448659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e305c1-76ae-4c9e-a5f8-5c3894817e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.448935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e305c1-76ae-4c9e-a5f8-5c3894817e87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.460110 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e305c1-76ae-4c9e-a5f8-5c3894817e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-58e305c1-76ae-4c9e-a5f8-5c3894817e87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:12.465579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:12.466553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:12.467353 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 275/536] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:12.474298 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8d33-970f-45ab-a937-70ce41ccec9e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:12.600120 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8d33-970f-45ab-a937-70ce41ccec9e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:12.635574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae92b36-bccd-4ded-b4e9-90d7e0d25049 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.635874 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae92b36-bccd-4ded-b4e9-90d7e0d25049 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.636127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae92b36-bccd-4ded-b4e9-90d7e0d25049 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.637731 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 276/537] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:12.638902 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:12.639592 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.639871 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.640140 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.640800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:12.641096 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:12.642514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:12.642726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4494-84f4-43e9-b04e-5a3238dc64df None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.643012 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4494-84f4-43e9-b04e-5a3238dc64df None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.643283 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a4494-84f4-43e9-b04e-5a3238dc64df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.651621 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 262/538] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:12.656871 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:12.666393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-ed0a4494-84f4-43e9-b04e-5a3238dc64df None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:12.667580 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-ed0a4494-84f4-43e9-b04e-5a3238dc64df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:12.686711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:12.737862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:12.747011 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 277/539] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:12.748263 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3098-0ce8-4490-aeab-4effdc5eabde None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.748547 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3098-0ce8-4490-aeab-4effdc5eabde None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.748822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f3098-0ce8-4490-aeab-4effdc5eabde None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.750529 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 278/540] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:12.754053 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f3098-0ce8-4490-aeab-4effdc5eabde None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:12.769200 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a4539-e08b-48fd-b952-fdc5308fd4a9 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:12.816634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba7bb9-e09d-459f-acf8-c8d11ca69c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:12.817260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7bb9-e09d-459f-acf8-c8d11ca69c47 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.817578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7bb9-e09d-459f-acf8-c8d11ca69c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.817848 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba7bb9-e09d-459f-acf8-c8d11ca69c47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.829176 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba7bb9-e09d-459f-acf8-c8d11ca69c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:12.830680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba7bb9-e09d-459f-acf8-c8d11ca69c47 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-a5ba7bb9-e09d-459f-acf8-c8d11ca69c47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:12.845512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:12.848508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:12.849369 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:12.849369 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:12.849369 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:12.853337 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 263/541] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:12.854951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69757e73-9369-4ca2-afa3-f985d4d5ca4e None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.854951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69757e73-9369-4ca2-afa3-f985d4d5ca4e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.855219 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69757e73-9369-4ca2-afa3-f985d4d5ca4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.870535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f3098-0ce8-4490-aeab-4effdc5eabde None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:12.873496 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-69757e73-9369-4ca2-afa3-f985d4d5ca4e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:12.874627 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-69757e73-9369-4ca2-afa3-f985d4d5ca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:12.907719 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a6cf-aeb1-47d2-80b1-281e34c36ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:12.908442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a6cf-aeb1-47d2-80b1-281e34c36ff2 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:12.908791 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a6cf-aeb1-47d2-80b1-281e34c36ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:12.909135 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a6cf-aeb1-47d2-80b1-281e34c36ff2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:12.919767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322a6cf-aeb1-47d2-80b1-281e34c36ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-b322a6cf-aeb1-47d2-80b1-281e34c36ff2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:12.924625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:12.929279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 279/542] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:12.931365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a6cf-aeb1-47d2-80b1-281e34c36ff2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:12.960469 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 264/543] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:12.961862 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69757e73-9369-4ca2-afa3-f985d4d5ca4e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:12.983033 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.001693 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.046665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a6cf-aeb1-47d2-80b1-281e34c36ff2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.085978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.086939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.087310 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.087677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.088443 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:13.088834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.090341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.100874 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69757e73-9369-4ca2-afa3-f985d4d5ca4e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.102738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 280/544] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:13.103443 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.144579 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.145275 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.145641 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.146100 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.146828 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:13.147196 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.148862 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.162394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 265/545] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:13.162394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.213193 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4f0f-eca2-45c5-b4ea-d8fff9559a6f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.229959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.233028 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.248316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e115-3fb6-4eff-a14f-7db80f675f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.248948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e115-3fb6-4eff-a14f-7db80f675f79 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.249241 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e115-3fb6-4eff-a14f-7db80f675f79 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.249531 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5e115-3fb6-4eff-a14f-7db80f675f79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.259976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5e115-3fb6-4eff-a14f-7db80f675f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-e3c5e115-3fb6-4eff-a14f-7db80f675f79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:13.264757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:13.265647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:13.266446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 281/546] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:13.267091 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e115-3fb6-4eff-a14f-7db80f675f79 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.271578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411da98-b121-4ed5-8703-d3c449c74c11 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.308008 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.308641 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.308916 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.309182 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.317171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.318652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:13.329720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:13.335384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 266/547] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:13.337173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.371738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5e115-3fb6-4eff-a14f-7db80f675f79 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.404433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.405056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.405337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.405657 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.417181 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.418691 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.431466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5d0fa-3421-4553-bd3f-03a83a018e86 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:13.432720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:13.433797 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:13.434824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:13.434824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:13.434824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:13.434824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 282/548] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:13.434824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.462561 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.463905 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.468351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.468956 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.469259 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.469553 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.470213 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:13.475082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.475082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.481548 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 267/549] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:13.482351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.537810 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64033b-4c51-4d70-a322-dbf125440e9c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.573593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87bee0-1557-4e26-bf65-f474a4c26f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.574214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87bee0-1557-4e26-bf65-f474a4c26f76 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.574491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87bee0-1557-4e26-bf65-f474a4c26f76 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.574758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87bee0-1557-4e26-bf65-f474a4c26f76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.584640 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87bee0-1557-4e26-bf65-f474a4c26f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:13.586671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669aef4-681c-47b7-9ace-84236c401f63 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-bd87bee0-1557-4e26-bf65-f474a4c26f76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:13.590357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:13.591309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 283/550] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:13.593154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87bee0-1557-4e26-bf65-f474a4c26f76 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.623425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.623957 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.624232 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.624502 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.625217 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:13.625576 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.627010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.643496 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 268/551] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:13.644380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.681071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.693270 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87bee0-1557-4e26-bf65-f474a4c26f76 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.693946 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.728061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.728661 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.728939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.729212 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.729870 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:13.730231 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.731580 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.742636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 284/552] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:13.743425 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.743870 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1c524-4cb4-42d5-8a0b-c3124f687dc4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.781570 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.782201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.782479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.782755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.792729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.794210 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:13.808145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:13.809253 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:13.810270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:13.810270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:13.810270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:13.810270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 269/553] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:13.810270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.845111 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f75bd-52d2-4124-bbbf-9ff2e016da3a None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.877219 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.877844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.878116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.878397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.879047 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] RBAC: Adding query filter params (name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:13.879345 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.880715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.889033 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 285/554] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:13.889862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.903838 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.912532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429addda-7489-4bbc-96cf-5e31c42bb1ae None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:13.914162 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:13.946947 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:13.947577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:13.947855 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:13.948128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:13.958410 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:13.959854 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:13.975132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:13.976272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:13.977824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:13.977824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:13.977824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:13.977824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 270/555] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:13.977824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:13.995460 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9461868-a371-4593-af6d-f16ba4c10a44 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.029751 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.030377 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.030665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.030941 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.038455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.040059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:14.050992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:14.052131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 286/556] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:14.053205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.083801 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90093ae1-21e2-4eeb-a77d-12be60fb7a8d None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.117994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.118682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.118964 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.119235 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.119870 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:14.120173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.121588 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.124973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:14.138757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 271/557] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:14.138757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.153936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:14.156362 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2149-ed31-436b-9e90-47598052f804 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.198703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.199334 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.199613 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.199904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.212917 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.214411 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:14.228946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:14.230545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:14.231451 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:14.231451 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:14.231451 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:14.231451 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 287/558] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:14.231451 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.241124 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f580b2-8305-4517-bc07-1732a7fa6235 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.275588 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.276188 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.276460 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.276721 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.277354 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:14.277681 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.279041 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.290350 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 272/559] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:14.291300 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.336698 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba732d4-93dc-4b38-bd71-bd6437314b7b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.358197 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:14.364568 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:14.369889 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.370494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.370853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.371145 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.371867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:14.372176 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.373639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.390109 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2ffbf-c93d-4731-9c24-9c3ebabcb743 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.391315 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 288/560] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:14.392531 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.425584 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.426301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.426686 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.427026 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.434940 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.436446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:14.447835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:14.448985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:14.450011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 273/561] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:14.450613 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.496694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df010ea-94a1-4578-9b67-0abf206c780a None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.529916 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.530608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.530959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.531304 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.532016 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:14.532395 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.533868 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.546365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 289/562] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:14.547246 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.561021 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad845c6-0f46-420c-aac1-d60d9d84224f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.590967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:14.595352 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.605346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.605346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.605346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.605346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:14.605346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.605875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:14.616560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:14.618255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 274/563] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:14.619430 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.654609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3caf41-33a6-48a8-89df-afee9c121e2b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.689429 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.690075 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.690359 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.690637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.702220 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.703654 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:14.717591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:14.718610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:14.719535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:14.719535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:14.719535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:14.719708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328750-8f3f-477f-944f-1914248b9852 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.719783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 290/564] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:14.719783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.753536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.754143 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.754422 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.754697 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.755415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:14.755722 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.757163 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.773841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 275/565] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:14.774637 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.818034 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:14.826520 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b0492-a7de-4aba-ad47-8881e699cfd8 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.827865 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:14.860887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.861548 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.861831 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.862107 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.869611 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.871070 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.874608 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2698982-0d67-40aa-bdab-8ca77e081604 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:14.881961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:14.883534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 291/566] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:14.884687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.913279 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:14.913851 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:14.914124 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:14.914928 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:14.915732 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:14.916040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:14.917472 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:14.928961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 276/567] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:14.929671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:14.990811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e6f72-6bda-40ed-bee8-7cfa8364ab87 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.024350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.025092 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.025378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.025687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.026326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:15.026634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.028016 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.029049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b01e99-9665-48bf-b9f1-7c6d2e0ab39a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.040569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 292/568] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:15.041382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.042525 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:15.056014 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:15.064491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.070082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.070082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.070082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.078843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.080305 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:15.094889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:15.095885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:15.096799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:15.096799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:15.096799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:15.096799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 277/569] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:15.096799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.145880 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04990cbf-639f-4918-a223-2b39198d0b54 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.181677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.182211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.182500 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.182774 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.183498 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:15.183811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.185240 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.200547 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fb577-f773-4588-9d1a-9a290c66f7e4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.203056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 293/570] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Aug 19 17:49:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:15.203714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.235709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa799b-59e9-47e7-8e52-ea7876a28c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.236368 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa799b-59e9-47e7-8e52-ea7876a28c50 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.236647 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa799b-59e9-47e7-8e52-ea7876a28c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.236917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa799b-59e9-47e7-8e52-ea7876a28c50 None admin] PATH_INFO: `/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/cbf8fe29550b480dbb5294af4dc962c6/roles/cc7ad901d358490aad038c78057fce9c` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.251797 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa799b-59e9-47e7-8e52-ea7876a28c50 None admin] RBAC: Authorizing `identity:create_grant(project_id=0faa0bfd1ad0406eb336f391d6846bbd, user_id=cbf8fe29550b480dbb5294af4dc962c6, role_id=cc7ad901d358490aad038c78057fce9c)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.253227 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa799b-59e9-47e7-8e52-ea7876a28c50 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.273777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:15.306326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e216832-f4e0-44d9-86de-a68eb189422f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.340704 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.341359 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.341661 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.341932 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.348486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.349945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:15.361058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:15.362188 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 294/571] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:15.363522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.458345 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e4527-8a7e-4b14-81b9-c8936fbf5bab None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.496902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.497735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.498165 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.498591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.499750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:15.500226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.502087 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.514327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 295/572] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:15.515140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.592041 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 278/573] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:49:15 2022] PUT /identity/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/cbf8fe29550b480dbb5294af4dc962c6/roles/cc7ad901d358490aad038c78057fce9c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:49:15.592879 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa799b-59e9-47e7-8e52-ea7876a28c50 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.597638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:15.613737 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:15.627211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b471d-d532-4108-8239-2dcd72a69351 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.670621 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.671281 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.671561 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.671832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.685442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.686985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:15.702945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:15.704094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:15.704999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:15.704999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:15.704999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:15.704999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 296/574] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:15.704999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.716143 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa799b-59e9-47e7-8e52-ea7876a28c50 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.754688 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:15.756180 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.756804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.757082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.757350 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.758130 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:15.759561 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.761081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.775685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 279/575] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:15.776527 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.832572 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd82eb-d080-410d-be8a-b0a50ed803ca None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.855906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:15.869687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.870599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.870881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.878846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.878846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.879689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.882252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecbefb-e5ed-4548-98b9-0ca8b63e36ff None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:15.891954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:15.893195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:15.894178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:15.894178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:15.894178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:15.894178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:15.894178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:15.894178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:15.894178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:15.894178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:15.900568 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 297/576] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:15.900568 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:15.919094 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:15.919740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:15.919997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:15.920242 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:15.920875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:15.921175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:15.922638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:15.936106 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 280/577] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:15.936823 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:16.007611 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035d307-d718-4d70-bc3d-5d2a1f8aa4be None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:16.010010 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:16.043065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa40777-4126-43a5-b198-afdedb11fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:16.044070 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa40777-4126-43a5-b198-afdedb11fb51 None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:16.044594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa40777-4126-43a5-b198-afdedb11fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:16.045071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa40777-4126-43a5-b198-afdedb11fb51 None admin] PATH_INFO: `/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/2d52483e48804cbfad701d198deea470/roles/cc7ad901d358490aad038c78057fce9c` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:16.050112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fe328-222c-42ef-b539-d3e629f18078 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:16.061207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa40777-4126-43a5-b198-afdedb11fb51 None admin] RBAC: Authorizing `identity:create_grant(project_id=0faa0bfd1ad0406eb336f391d6846bbd, user_id=2d52483e48804cbfad701d198deea470, role_id=cc7ad901d358490aad038c78057fce9c)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:16.062999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa40777-4126-43a5-b198-afdedb11fb51 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:16.084581 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:16.085233 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:16.085533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:16.085800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:16.087023 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:16.087318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:16.088738 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:16.090383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:16.101103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 281/578] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:16.101767 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:16.145461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 298/579] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:49:15 2022] PUT /identity/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/2d52483e48804cbfad701d198deea470/roles/cc7ad901d358490aad038c78057fce9c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:49:16.145461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa40777-4126-43a5-b198-afdedb11fb51 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:16.239161 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb9dc8-6d82-4fab-b654-f06609a58ff4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:16.272571 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa40777-4126-43a5-b198-afdedb11fb51 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:16.289790 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:16.290549 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:16.291160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:16.291542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:16.302510 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:16.304144 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:16.317338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:16.318607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:16.319717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:16.319717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:16.319717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:16.319717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:16.319717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:16.319717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:16.319717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:16.319717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:16.325448 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 282/580] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:16.325614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425b4f8-cabc-40e2-86f9-80dd2322f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:16.325614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425b4f8-cabc-40e2-86f9-80dd2322f9d3 None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:16.325614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425b4f8-cabc-40e2-86f9-80dd2322f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:16.325614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425b4f8-cabc-40e2-86f9-80dd2322f9d3 None admin] PATH_INFO: `/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/b864fd056be54f2986135bbb77bdf7d2/roles/cc7ad901d358490aad038c78057fce9c` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:16.327521 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:16.346296 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425b4f8-cabc-40e2-86f9-80dd2322f9d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0faa0bfd1ad0406eb336f391d6846bbd, user_id=b864fd056be54f2986135bbb77bdf7d2, role_id=cc7ad901d358490aad038c78057fce9c)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:16.347114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e425b4f8-cabc-40e2-86f9-80dd2322f9d3 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:16.399190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:16.447941 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2402f6-f59f-4acb-8be8-72a5c9f7c8ba None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:16.451775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 299/581] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:49:16 2022] PUT /identity/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/b864fd056be54f2986135bbb77bdf7d2/roles/cc7ad901d358490aad038c78057fce9c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:49:16.490740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c98da-b3d6-467b-8833-e23c72eb200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:16.491411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c98da-b3d6-467b-8833-e23c72eb200f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:16.491699 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c98da-b3d6-467b-8833-e23c72eb200f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:16.491974 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c98da-b3d6-467b-8833-e23c72eb200f None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:16.493261 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c98da-b3d6-467b-8833-e23c72eb200f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:16.493619 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c98da-b3d6-467b-8833-e23c72eb200f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:16.495161 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c98da-b3d6-467b-8833-e23c72eb200f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:16.510248 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 283/582] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:16.515961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425b4f8-cabc-40e2-86f9-80dd2322f9d3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:16.525108 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:16.639979 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e425b4f8-cabc-40e2-86f9-80dd2322f9d3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:16.679833 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5044-6094-4838-8583-8fa552651149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:16.680976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5044-6094-4838-8583-8fa552651149 None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:16.681402 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5044-6094-4838-8583-8fa552651149 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:16.681823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5044-6094-4838-8583-8fa552651149 None admin] PATH_INFO: `/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/7fb05df536de4b159101ffa5cc41c5ee/roles/cc7ad901d358490aad038c78057fce9c` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:16.698289 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf5044-6094-4838-8583-8fa552651149 None admin] RBAC: Authorizing `identity:create_grant(project_id=0faa0bfd1ad0406eb336f391d6846bbd, user_id=7fb05df536de4b159101ffa5cc41c5ee, role_id=cc7ad901d358490aad038c78057fce9c)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:16.699759 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf5044-6094-4838-8583-8fa552651149 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:16.769520 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 300/583] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:49:16 2022] PUT /identity/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/7fb05df536de4b159101ffa5cc41c5ee/roles/cc7ad901d358490aad038c78057fce9c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:49:17.844048 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112efe4-4626-40d0-bf46-866204cf46e6 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:17.844545 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112efe4-4626-40d0-bf46-866204cf46e6 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:17.844545 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112efe4-4626-40d0-bf46-866204cf46e6 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:17.846303 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 284/584] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:17.852101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff88b-8fba-460d-b749-49b26bb45c66 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:17.852746 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff88b-8fba-460d-b749-49b26bb45c66 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:17.852746 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff88b-8fba-460d-b749-49b26bb45c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:17.871521 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-137ff88b-8fba-460d-b749-49b26bb45c66 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:17.872726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-137ff88b-8fba-460d-b749-49b26bb45c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:17.925223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:17.947228 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 301/585] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:18.279476 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112efe4-4626-40d0-bf46-866204cf46e6 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:18.396115 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112efe4-4626-40d0-bf46-866204cf46e6 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:18.418612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:18.433987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee1b07-6903-4ebe-8b3a-b98ed62a61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:18.437572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee1b07-6903-4ebe-8b3a-b98ed62a61a3 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:18.437572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee1b07-6903-4ebe-8b3a-b98ed62a61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:18.437572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee1b07-6903-4ebe-8b3a-b98ed62a61a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:18.445887 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee1b07-6903-4ebe-8b3a-b98ed62a61a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-60ee1b07-6903-4ebe-8b3a-b98ed62a61a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:18.450762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:18.451911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:18.452762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 285/586] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:18.458274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff88b-8fba-460d-b749-49b26bb45c66 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:18.462858 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9eb50-1341-4aa8-aa00-5123b5607c83 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:18.463142 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9eb50-1341-4aa8-aa00-5123b5607c83 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:18.463422 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9eb50-1341-4aa8-aa00-5123b5607c83 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:18.465048 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 286/587] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:49:18.470316 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbee8-4b9a-4650-90e4-abfc53bd0b81 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:18.470610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbee8-4b9a-4650-90e4-abfc53bd0b81 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:18.471140 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfbee8-4b9a-4650-90e4-abfc53bd0b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:18.500763 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-79cfbee8-4b9a-4650-90e4-abfc53bd0b81 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:18.502007 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-79cfbee8-4b9a-4650-90e4-abfc53bd0b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:18.585127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 287/588] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:18.598481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff88b-8fba-460d-b749-49b26bb45c66 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:18.639900 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94747b-5088-43c5-a053-d438b49fc471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:18.640970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94747b-5088-43c5-a053-d438b49fc471 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:18.641501 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94747b-5088-43c5-a053-d438b49fc471 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:18.642077 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94747b-5088-43c5-a053-d438b49fc471 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:18.642973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94747b-5088-43c5-a053-d438b49fc471 None admin] RBAC: Adding query filter params (name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:18.643498 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94747b-5088-43c5-a053-d438b49fc471 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:18.645110 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94747b-5088-43c5-a053-d438b49fc471 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:18.655083 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 302/589] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:18.661381 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfbee8-4b9a-4650-90e4-abfc53bd0b81 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:18.769174 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfbee8-4b9a-4650-90e4-abfc53bd0b81 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:18.771955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:18.783531 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653c343-579d-43f4-8277-b125b3490190 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:18.783878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653c343-579d-43f4-8277-b125b3490190 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:18.790927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653c343-579d-43f4-8277-b125b3490190 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:18.790927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 303/590] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:18.792318 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca2308-47f4-4cfa-924a-32e4a1363000 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:18.792809 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca2308-47f4-4cfa-924a-32e4a1363000 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:18.793279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca2308-47f4-4cfa-924a-32e4a1363000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:18.813265 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:18.814329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:18.814807 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:18.815269 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:18.815792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-b4ca2308-47f4-4cfa-924a-32e4a1363000 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:18.817238 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-b4ca2308-47f4-4cfa-924a-32e4a1363000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:18.828332 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:18.830187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:18.845919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:18.847341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:18.848229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:18.848229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:18.848229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:18.850122 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 288/591] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:18.855661 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:18.869059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:18.917463 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 304/592] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:18.926802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca2308-47f4-4cfa-924a-32e4a1363000 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:18.993164 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d854d6f-b58c-4d9b-b7df-bd0c57dc17d7 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.041218 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7fa9-7002-45f2-b762-e1b5dc0646ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.041896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7fa9-7002-45f2-b762-e1b5dc0646ab None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.042174 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7fa9-7002-45f2-b762-e1b5dc0646ab None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.042447 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7fa9-7002-45f2-b762-e1b5dc0646ab None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.043478 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7fa9-7002-45f2-b762-e1b5dc0646ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:19.043785 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7fa9-7002-45f2-b762-e1b5dc0646ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:19.045455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7fa9-7002-45f2-b762-e1b5dc0646ab None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:19.058818 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 289/593] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:19.059728 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca2308-47f4-4cfa-924a-32e4a1363000 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.060571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52bf27-f47f-4c73-9eca-2c50a9b58a5b None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.061071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52bf27-f47f-4c73-9eca-2c50a9b58a5b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.061572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52bf27-f47f-4c73-9eca-2c50a9b58a5b None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.062973 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 290/594] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:19.064193 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52bf27-f47f-4c73-9eca-2c50a9b58a5b None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.087202 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:19.103610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9ff97-f37a-44aa-9972-76c1909e021a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.104069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ff97-f37a-44aa-9972-76c1909e021a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.104354 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ff97-f37a-44aa-9972-76c1909e021a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.104625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ff97-f37a-44aa-9972-76c1909e021a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.114926 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9ff97-f37a-44aa-9972-76c1909e021a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-e3d9ff97-f37a-44aa-9972-76c1909e021a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:19.119725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:19.120726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:19.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 305/595] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:19.123032 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff867e3b-c110-432a-a055-d1e559b553f2 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.123316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff867e3b-c110-432a-a055-d1e559b553f2 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.123588 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff867e3b-c110-432a-a055-d1e559b553f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.142788 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-ff867e3b-c110-432a-a055-d1e559b553f2 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:19.143993 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-ff867e3b-c110-432a-a055-d1e559b553f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:19.172655 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:19.185531 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52bf27-f47f-4c73-9eca-2c50a9b58a5b None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.215603 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 306/596] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:19.218716 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff867e3b-c110-432a-a055-d1e559b553f2 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.223081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.223918 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.224427 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.224900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.232778 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:19.234528 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:19.247394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:19.248411 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:19.249396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:19.256387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 291/597] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:19.257240 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.338302 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff867e3b-c110-432a-a055-d1e559b553f2 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.343940 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:19.365624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dd3bf-60f7-411a-97be-be8a72e5831a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.376775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.377454 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.377739 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.378017 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.378741 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] RBAC: Adding query filter params (name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:19.379051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:19.380486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:19.393469 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 307/598] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:19.393469 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.406522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.407131 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.407410 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.407685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.408435 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:19.408742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:19.410203 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:19.422210 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:19.428248 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 292/599] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:19.434069 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.505045 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaccb1d-d2ff-463f-b9d7-eb94655caedf None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.540536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab5325-f467-489d-9a23-7f43f0a34d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.541169 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab5325-f467-489d-9a23-7f43f0a34d98 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.541490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab5325-f467-489d-9a23-7f43f0a34d98 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.541771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab5325-f467-489d-9a23-7f43f0a34d98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.546291 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392864-8cbc-4b99-a300-1885084b4e85 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.552168 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab5325-f467-489d-9a23-7f43f0a34d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-13ab5325-f467-489d-9a23-7f43f0a34d98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:19.557881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:19.558898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 308/600] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:19.560242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab5325-f467-489d-9a23-7f43f0a34d98 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.583679 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.584296 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.584571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.584839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.587045 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:19.595982 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:19.600079 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:19.611663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:19.612659 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:19.613989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:19.613989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:19.613989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:19.613989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 293/601] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:19.613989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.647567 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:19.662267 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab5325-f467-489d-9a23-7f43f0a34d98 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.697540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ab27a-15f9-4ecd-9499-000f57a2e91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.698140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ab27a-15f9-4ecd-9499-000f57a2e91f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.698422 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ab27a-15f9-4ecd-9499-000f57a2e91f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.698700 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ab27a-15f9-4ecd-9499-000f57a2e91f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.714412 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4306a-95ed-41f7-8301-d90be7aaa340 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.748112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038650-eb9d-4903-a9d1-d55cc1de3e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.748738 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038650-eb9d-4903-a9d1-d55cc1de3e41 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.749025 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038650-eb9d-4903-a9d1-d55cc1de3e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.749299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac038650-eb9d-4903-a9d1-d55cc1de3e41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.759477 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac038650-eb9d-4903-a9d1-d55cc1de3e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-ac038650-eb9d-4903-a9d1-d55cc1de3e41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:19.764498 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:19.765682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:49:19.766532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:19.767160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ab27a-15f9-4ecd-9499-000f57a2e91f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:19.767160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ab27a-15f9-4ecd-9499-000f57a2e91f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:19.769575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 294/602] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:19.770528 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038650-eb9d-4903-a9d1-d55cc1de3e41 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.816353 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:19.847707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:19.862948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 309/603] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:19.863762 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ab27a-15f9-4ecd-9499-000f57a2e91f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.870268 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac038650-eb9d-4903-a9d1-d55cc1de3e41 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.904759 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.905286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:19.905589 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:19.905859 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:19.906505 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:19.906806 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:19.908166 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:19.916429 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 295/604] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:19.917219 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:19.965096 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ab27a-15f9-4ecd-9499-000f57a2e91f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:19.999308 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:19.999939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.000222 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.000499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.001153 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:20.001474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.002856 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.013931 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 310/605] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:20.014729 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.025959 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b33b1c-2f62-48e3-aef9-d67cc6b7651f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.034675 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.060072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.060675 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.060950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.061300 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.061895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:20.062351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.062467 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.063574 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.073482 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 296/606] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:49:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:20.074442 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.116987 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bd378-8951-480f-9ad7-3b9ebb1d2bdf None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.151636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.152262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.152550 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.152824 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.163668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.165833 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.178851 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2a553-1a53-4325-a5ae-8af0ed6ba755 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:20.179639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:20.180776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:20.181922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:20.181922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:20.181922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:20.181922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 311/607] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:20.182199 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.215899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.216622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.216966 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.217302 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.227677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.229165 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:20.243446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:20.244556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:20.245677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:20.245677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:20.245677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:20.245677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 297/608] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:20.245930 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.272232 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.287382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.291714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491aff29-cf3e-4982-bb37-25afbb48b881 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.324952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.325597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.325876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.326145 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.333464 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.335290 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:20.346589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:20.347626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 312/609] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:20.348581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.349231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671899d4-1831-4e6c-87b8-e101eedc4f9e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.384298 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.384931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.385213 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.385522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.396223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.397953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:20.412821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:20.415880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:20.416942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:20.416942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:20.416942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:20.419139 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 298/610] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:20.419834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.455361 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74fb2e-d12f-4983-9876-353c970afc75 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.491160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.491801 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.492094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.492360 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.493973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:20.494283 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.495678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.496680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.507534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 313/611] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:20.510554 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.521651 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317dda5e-47c1-4994-be14-30fcb0244ea8 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.529848 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.556130 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.557534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.557534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.557841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.558263 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:20.558572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.559946 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.572064 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 299/612] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:20.572854 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.610178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773a00f-b8a6-4edb-a462-d733c2622e7d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.644706 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.645309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.645614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.645887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.646614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:20.646921 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.648356 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.666127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 314/613] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:20.666864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.676252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a336ac-c38e-4ebd-8690-edc34bdeb064 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.709481 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.710083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.710362 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.710634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.711914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:20.712145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.713480 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.714933 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.724819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 300/614] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:20.725639 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.744107 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.766285 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c166df-31b1-4dd6-a682-eeff0d7ca288 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.800792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.801691 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.801982 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.802239 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.808926 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.810419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:20.821816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:20.822715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:20.823618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 315/615] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:20.824119 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.831339 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429e97c-c638-4922-8933-11533fcb091c None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.865333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.865990 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.866265 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.866532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.874302 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:20.875736 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:20.887039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:20.890519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 301/616] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:20.891685 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:20.931534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e613c-f1e5-4e22-b7d0-75f360e4907c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:20.949712 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.966771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408fb5-95c4-4472-879e-be453d5db846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:20.967375 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408fb5-95c4-4472-879e-be453d5db846 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:20.968566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408fb5-95c4-4472-879e-be453d5db846 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:20.968566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8408fb5-95c4-4472-879e-be453d5db846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:20.971279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:20.994146 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01540e4-129b-40bb-9837-eb96be7e03dd None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.028448 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.029071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.029351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.029655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.034530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8408fb5-95c4-4472-879e-be453d5db846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.036274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8408fb5-95c4-4472-879e-be453d5db846 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.037163 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.038649 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:21.049917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:21.051063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 302/617] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:21.052231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.139494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 316/618] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:21.140327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408fb5-95c4-4472-879e-be453d5db846 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.154021 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43900ef-880f-421e-9479-86b53e65b66f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.168330 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:21.174192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:21.188085 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.188626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.188905 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.189178 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.189887 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:21.190197 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.191612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.205002 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 303/619] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:21.205925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.238671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8408fb5-95c4-4472-879e-be453d5db846 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.272928 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.273556 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.274509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.274928 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.275662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:21.275969 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.277405 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.295164 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 317/620] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:21.296397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.310928 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf5aa4-efc0-4308-b124-95ca02a900ae None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.345403 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.346035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.346314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.346586 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.347306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:21.347611 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.349040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.371455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 304/621] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:21.371455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.391151 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:21.397779 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f24722-8865-4626-a7ce-f23d626b8d92 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.401662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:21.433342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.434040 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.434319 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.434589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.444508 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.446076 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:21.461044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:21.462259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:21.463224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:21.463224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:21.463224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:21.463224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 318/622] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:21.463224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.474057 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd276266-fc0d-4216-8c3f-1d7d8289766f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.511377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.511988 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.512270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.512540 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.513252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=cbf8fe29550b480dbb5294af4dc962c6) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:21.513598 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.515029 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.520554 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 305/623] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/role_assignments?user.id=cbf8fe29550b480dbb5294af4dc962c6&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:21.521315 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.574306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd935b6-ab1b-4bf3-b88e-d43fb8c163c0 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.614441 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac99d7-cfd7-441f-b541-9efd7dcf3d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.615066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac99d7-cfd7-441f-b541-9efd7dcf3d28 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.615348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac99d7-cfd7-441f-b541-9efd7dcf3d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.615618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac99d7-cfd7-441f-b541-9efd7dcf3d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.632263 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:21.634691 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:21.641367 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5070d-4dac-43a8-a632-2d803eb31d22 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.679614 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b55ff-3c35-4bba-b373-dcb5c3ae99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.680386 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b55ff-3c35-4bba-b373-dcb5c3ae99cd None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.680729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b55ff-3c35-4bba-b373-dcb5c3ae99cd None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.681064 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b55ff-3c35-4bba-b373-dcb5c3ae99cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.691502 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac99d7-cfd7-441f-b541-9efd7dcf3d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.693084 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac99d7-cfd7-441f-b541-9efd7dcf3d28 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.761839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b55ff-3c35-4bba-b373-dcb5c3ae99cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.763003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b55ff-3c35-4bba-b373-dcb5c3ae99cd None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.812145 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 319/624] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:21.813330 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac99d7-cfd7-441f-b541-9efd7dcf3d28 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.862725 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:21.882491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:21.889365 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 306/625] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:21.890861 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b55ff-3c35-4bba-b373-dcb5c3ae99cd None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:21.917236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac99d7-cfd7-441f-b541-9efd7dcf3d28 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:21.953346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:21.954265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:21.954545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:21.954818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:21.955455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:21.955758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:21.957164 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:21.969801 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 320/626] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:21.974495 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.006191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b55ff-3c35-4bba-b373-dcb5c3ae99cd None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.046211 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.046784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.047391 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.047391 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.057910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.059381 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:22.075671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:22.076665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:22.078314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:22.078314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:22.078314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:22.078314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 307/627] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:22.078314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.090189 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a55b4e-f69b-403f-9d84-c119c7fb2089 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.097956 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:22.125870 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.126504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.126776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.127044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.131328 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:22.139144 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.140783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:22.155235 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:22.156400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:22.157631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:22.157631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:22.157631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:22.157631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 321/628] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:22.157631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.189643 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edd2d4-e272-4544-a206-8e04babed4ed None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.224782 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.225461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.225744 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.226014 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.233632 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.235075 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:22.247906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:22.254495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 308/629] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:22.255636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.275324 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977afe-5104-4418-a879-13ce7d05a5c9 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.311734 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.312263 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.312544 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.312822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.313481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:22.313800 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.315179 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.328191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 322/630] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:22.328991 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.350172 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:22.366082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa24426-1fb6-4846-8966-556b6afb07c4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.379182 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:22.405693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.406300 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.406573 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.406841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.407496 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:22.407798 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.409144 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.425853 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 309/631] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:22.425853 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.439590 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54e630-f717-418b-b268-fa8f51b31ce2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.476396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.477171 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.477476 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.478137 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.478877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:22.479143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.480628 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.498637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 323/632] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:22.499502 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.543433 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94f9e0-34a1-4a54-9769-a1bd7baf1a7e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.578551 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.579109 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.579398 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.579663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.586421 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.586676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:22.587875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:22.599461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:22.600407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:22.601310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 310/633] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:22.601847 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.617052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3a728-d2d3-401b-8a9e-8bbf0452011b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.633277 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:22.656101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.656737 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.657021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.657303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.664429 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.667243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:22.677677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:22.678823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:22.679768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 324/634] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:22.680871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.715854 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d550618-412f-4ecc-9ff5-5a37d7467631 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.756252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.756863 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.757144 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.757439 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.758201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=2d52483e48804cbfad701d198deea470) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:22.758618 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.760057 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.765883 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 311/635] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/role_assignments?user.id=2d52483e48804cbfad701d198deea470&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:22.766666 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.811393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df0d19-9558-435c-89b5-bca8de88b995 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.852394 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.852940 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.853219 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.853530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.855064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:22.857986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.859617 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.868897 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:22.879660 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 325/636] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:22.884218 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:22.908359 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:22.919380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8320d-7c47-4477-835c-3846b485f3f1 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:22.959938 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:22.960638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:22.961058 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:22.961195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:22.963239 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:22.963504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:22.965130 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:22.979279 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 312/637] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:22.985330 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:23.015650 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5cde4-24fa-41d9-be90-81d01da8a1af None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:23.056962 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d680a8-46c9-4cac-9f12-622f989034a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:23.057602 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d680a8-46c9-4cac-9f12-622f989034a6 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:23.057878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d680a8-46c9-4cac-9f12-622f989034a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:23.058146 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d680a8-46c9-4cac-9f12-622f989034a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:23.058870 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d680a8-46c9-4cac-9f12-622f989034a6 None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=b864fd056be54f2986135bbb77bdf7d2) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:23.059176 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d680a8-46c9-4cac-9f12-622f989034a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:23.060629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d680a8-46c9-4cac-9f12-622f989034a6 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:23.067700 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 326/638] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/role_assignments?user.id=b864fd056be54f2986135bbb77bdf7d2&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:23.123578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e4a4e-0cf8-40d3-8bce-f46f5644e9eb None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:23.166325 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991c78d-d871-4c60-bb3e-2f24165d4ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:23.166959 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991c78d-d871-4c60-bb3e-2f24165d4ddc None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:23.167238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991c78d-d871-4c60-bb3e-2f24165d4ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:23.167558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991c78d-d871-4c60-bb3e-2f24165d4ddc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:23.168267 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991c78d-d871-4c60-bb3e-2f24165d4ddc None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=7fb05df536de4b159101ffa5cc41c5ee) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:23.168574 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991c78d-d871-4c60-bb3e-2f24165d4ddc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:23.170093 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991c78d-d871-4c60-bb3e-2f24165d4ddc None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:23.177179 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 313/639] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:22 2022] GET /identity/v3/role_assignments?user.id=7fb05df536de4b159101ffa5cc41c5ee&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:23.819532 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae28b7-1f08-44f6-95f7-9ab148ba35ca None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:23.819718 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae28b7-1f08-44f6-95f7-9ab148ba35ca None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:23.819997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae28b7-1f08-44f6-95f7-9ab148ba35ca None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:23.822169 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 327/640] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:23.827285 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2ea1d-0ea2-4665-9b81-aef5534bd307 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:23.827577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2ea1d-0ea2-4665-9b81-aef5534bd307 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:23.827852 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2ea1d-0ea2-4665-9b81-aef5534bd307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:23.846239 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-8fa2ea1d-0ea2-4665-9b81-aef5534bd307 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:23.847435 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-8fa2ea1d-0ea2-4665-9b81-aef5534bd307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:23.858117 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:23.916425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 314/641] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:24.253565 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae28b7-1f08-44f6-95f7-9ab148ba35ca None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:24.321803 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:24.370016 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae28b7-1f08-44f6-95f7-9ab148ba35ca None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:24.404684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4815-14e0-449c-8f96-0a57c0f0269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:24.405367 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4815-14e0-449c-8f96-0a57c0f0269e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:24.405676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4815-14e0-449c-8f96-0a57c0f0269e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:24.405950 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe4815-14e0-449c-8f96-0a57c0f0269e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:24.417743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effe4815-14e0-449c-8f96-0a57c0f0269e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-effe4815-14e0-449c-8f96-0a57c0f0269e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:24.423056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:24.424060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:24.425585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 328/642] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:24.430132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2ea1d-0ea2-4665-9b81-aef5534bd307 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:24.542898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2ea1d-0ea2-4665-9b81-aef5534bd307 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:24.578692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:24.579643 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:24.580124 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:24.580592 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:24.581491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:24.582023 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:24.583581 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:24.593291 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 315/643] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:24.598691 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4815-14e0-449c-8f96-0a57c0f0269e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:24.708574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe4815-14e0-449c-8f96-0a57c0f0269e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:24.733711 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:24.746040 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:24.746687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:24.748052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:24.748052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:24.758047 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:24.759646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:24.775357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:24.776489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:24.777578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:24.777578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:24.777578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:24.777578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 329/644] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:24.782921 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:24.795706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:24.891438 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf83755-0111-4779-866f-8db8b287d100 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:24.926410 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:24.927066 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:24.927292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:24.927568 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:24.928271 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:24.928583 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:24.929984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:24.943400 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 316/645] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:24.950827 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:25.063943 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c10128-aab7-4d1b-9da8-95016fab7ed4 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:25.103457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21be878-d3c7-4e50-86d2-15578080d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:25.104094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be878-d3c7-4e50-86d2-15578080d578 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.104376 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be878-d3c7-4e50-86d2-15578080d578 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.104659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be878-d3c7-4e50-86d2-15578080d578 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.112676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21be878-d3c7-4e50-86d2-15578080d578 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:25.114159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21be878-d3c7-4e50-86d2-15578080d578 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-a21be878-d3c7-4e50-86d2-15578080d578 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:25.125620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:25.126637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:25.127609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 330/646] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Aug 19 17:49:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:25.135077 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:25.178272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7950ac-8390-4358-b84b-21e41cae296f None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.178614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7950ac-8390-4358-b84b-21e41cae296f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.178823 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7950ac-8390-4358-b84b-21e41cae296f None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.180469 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 331/647] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:25.185557 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7887b-0667-4539-b8c0-506a06693b75 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.185955 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7887b-0667-4539-b8c0-506a06693b75 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.186331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7887b-0667-4539-b8c0-506a06693b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.205843 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-25b7887b-0667-4539-b8c0-506a06693b75 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:25.207180 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-25b7887b-0667-4539-b8c0-506a06693b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:25.210336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:25.236768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:25.251616 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d583922-2f88-4f5e-8a5b-d9d07b414a99 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:25.281740 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 332/648] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:25.302910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674c6c-3572-45e0-80b1-fb1509e293f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:25.303546 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674c6c-3572-45e0-80b1-fb1509e293f5 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.303829 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674c6c-3572-45e0-80b1-fb1509e293f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.304106 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674c6c-3572-45e0-80b1-fb1509e293f5 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.304992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674c6c-3572-45e0-80b1-fb1509e293f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:25.305338 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674c6c-3572-45e0-80b1-fb1509e293f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:25.306970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674c6c-3572-45e0-80b1-fb1509e293f5 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:25.329079 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 317/649] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Aug 19 17:49:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:25.335509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7887b-0667-4539-b8c0-506a06693b75 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:25.444095 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7887b-0667-4539-b8c0-506a06693b75 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:25.479392 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbb7e0-6465-4656-8dc8-8cb355d1db5c None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.479713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbb7e0-6465-4656-8dc8-8cb355d1db5c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.479938 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbb7e0-6465-4656-8dc8-8cb355d1db5c None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.480560 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685ae0-c002-47c4-a8df-b2cb9b4aa287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:25.481170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685ae0-c002-47c4-a8df-b2cb9b4aa287 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.485023 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685ae0-c002-47c4-a8df-b2cb9b4aa287 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.485023 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3685ae0-c002-47c4-a8df-b2cb9b4aa287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.488000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 318/650] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:25.488000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad3fe-1c25-40e5-a499-d5e4629bc7e7 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.488000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad3fe-1c25-40e5-a499-d5e4629bc7e7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.488000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad3fe-1c25-40e5-a499-d5e4629bc7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.514493 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-133ad3fe-1c25-40e5-a499-d5e4629bc7e7 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:25.515709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-133ad3fe-1c25-40e5-a499-d5e4629bc7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:25.529469 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:25.572662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3685ae0-c002-47c4-a8df-b2cb9b4aa287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:25.574540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3685ae0-c002-47c4-a8df-b2cb9b4aa287 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:25.599450 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 319/651] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:25.600714 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b64ea-de68-429c-abf5-85bd9a752fdc None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.601003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b64ea-de68-429c-abf5-85bd9a752fdc None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.601273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b64ea-de68-429c-abf5-85bd9a752fdc None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.605459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 320/652] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:25.607894 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee60e-faa5-4ac1-893d-19efec49e3d1 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.608242 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee60e-faa5-4ac1-893d-19efec49e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.608585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aee60e-faa5-4ac1-893d-19efec49e3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.627239 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-f0aee60e-faa5-4ac1-893d-19efec49e3d1 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:25.628712 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-f0aee60e-faa5-4ac1-893d-19efec49e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:25.682708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:25.692580 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 333/653] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 19 17:49:25.693650 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685ae0-c002-47c4-a8df-b2cb9b4aa287 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:25.704177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 321/654] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:25.705245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee60e-faa5-4ac1-893d-19efec49e3d1 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:25.790108 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:25.818081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aee60e-faa5-4ac1-893d-19efec49e3d1 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:25.832105 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3685ae0-c002-47c4-a8df-b2cb9b4aa287 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:25.863542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:25.864444 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.864727 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.865001 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.868686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:25.869448 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:25.869868 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:25.870262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] PATH_INFO: `/v3/services/image` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:25.870951 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:25.872436 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:25.877445 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:25.878994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:25.884272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:25.885871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:25.887863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:25.893066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 334/655] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Aug 19 17:49:25 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:25.893066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:25.894258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:25.895992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:25.897168 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:25.897168 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:25.897168 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:25.897168 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 322/656] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:25.900543 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:25.944654 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:26.007879 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7c81f-0839-46a5-9818-c0a5d46334c2 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.029671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb37f-38b9-4e88-a713-caa33f7d673d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.042487 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.043097 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.043380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.043657 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.044300 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:26.044605 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.046015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.058514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 323/657] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:26.059311 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.066711 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:26.075046 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.075658 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.075939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.076216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.076842 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:26.077146 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.078571 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.082811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 335/658] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:26.083584 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.156718 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:26.160467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b052cd-beae-4d6f-a033-fa6bb99c7ead None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.184121 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e40d0-602d-48bc-965a-8aca3ffa89d7 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.194318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.194948 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.195227 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.195496 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] PATH_INFO: `/v3/services/network` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.196101 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.197530 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:26.207821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:26.208803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:26.209694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 324/659] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:26.210493 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.221716 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.222352 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.222631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.222903 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.223489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.224861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:26.234574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:26.235747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:26.236593 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 336/660] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:26.237456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.292445 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:26.314285 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec37c4-4106-4cef-9ab8-c7118ce7f2e6 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.335558 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f67480-9286-4f22-9ed9-7c5cd50b59e1 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.348029 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.348654 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.348934 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.349210 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.356312 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.357863 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:26.368684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:26.369610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:26.370520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 325/661] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:26.371049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.371137 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.371207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.371207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.371207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.371847 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] RBAC: Adding query filter params (type=image) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:26.372143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.373555 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.379067 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 337/662] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:26.379861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.409509 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:26.501775 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6090d-fd86-444d-af86-9de29fa0c0dc None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.508073 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89234c-55ff-44fb-ba51-d9e6f13eb077 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.533873 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:26.542696 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.543524 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.544257 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.545281 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.545281 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] RBAC: Adding query filter params (name=network) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:26.550021 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.550021 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.552883 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 326/663] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:26.554663 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.564021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.565294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.565294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.565294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.569977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:26.569977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.569977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.579156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 338/664] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:26.580159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.676170 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:26.695303 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306e036-774d-4af1-8717-0d8aec135937 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.719533 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010a88b-005d-44a9-a6fe-dd85008b288a None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.750706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.751324 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.751604 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.751876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.752567 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:26.753332 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.754724 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.772457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:26.773136 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:26.773455 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:26.773772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:26.774976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:26.775278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:26.776668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:26.781198 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 327/665] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:26.782461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 339/666] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:26.786808 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.788375 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:26.865650 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:26.960642 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f99cf-a837-48f4-820f-5383945369b1 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:26.987902 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdc121-30b4-48d1-a70b-cf021aa30d26 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:27.014855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81476d-33ac-4058-8a5c-59433a6b8894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:27.015469 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81476d-33ac-4058-8a5c-59433a6b8894 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:27.015750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81476d-33ac-4058-8a5c-59433a6b8894 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:27.016024 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81476d-33ac-4058-8a5c-59433a6b8894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:27.016857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81476d-33ac-4058-8a5c-59433a6b8894 None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=cbf8fe29550b480dbb5294af4dc962c6) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:27.017177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81476d-33ac-4058-8a5c-59433a6b8894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:27.019596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81476d-33ac-4058-8a5c-59433a6b8894 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:27.034035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 340/667] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/role_assignments?user.id=cbf8fe29550b480dbb5294af4dc962c6&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=757702b4209942a3b2ec7bf21d995169 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:27.061809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0aff2-c418-4de2-b9f2-64aa06103d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:27.062808 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0aff2-c418-4de2-b9f2-64aa06103d31 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:27.063312 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0aff2-c418-4de2-b9f2-64aa06103d31 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:27.063787 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0aff2-c418-4de2-b9f2-64aa06103d31 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:27.064642 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0aff2-c418-4de2-b9f2-64aa06103d31 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:27.065180 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0aff2-c418-4de2-b9f2-64aa06103d31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:27.066953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0aff2-c418-4de2-b9f2-64aa06103d31 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:27.075360 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 328/668] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Aug 19 17:49:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:28.681919 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040cd70-ca87-4e03-b5a6-de19897e601b None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:28.682955 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040cd70-ca87-4e03-b5a6-de19897e601b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:28.683436 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040cd70-ca87-4e03-b5a6-de19897e601b None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:28.685323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 341/669] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:28.690921 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f979c9-8faf-4561-a3f9-5b4238def010 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:28.691731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f979c9-8faf-4561-a3f9-5b4238def010 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:28.692223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f979c9-8faf-4561-a3f9-5b4238def010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:28.711803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-18f979c9-8faf-4561-a3f9-5b4238def010 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:28.713715 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-18f979c9-8faf-4561-a3f9-5b4238def010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:28.716967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:28.786555 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 329/670] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:29.088010 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f925d0-287e-4afa-80d2-2a814c15db8b None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.088315 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f925d0-287e-4afa-80d2-2a814c15db8b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.088588 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f925d0-287e-4afa-80d2-2a814c15db8b None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.090215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 342/671] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:29.098082 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550eabc-0a05-4f9c-bbcd-4fa58427bc73 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.098471 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550eabc-0a05-4f9c-bbcd-4fa58427bc73 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.098840 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550eabc-0a05-4f9c-bbcd-4fa58427bc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.119760 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-b550eabc-0a05-4f9c-bbcd-4fa58427bc73 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:29.120988 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-b550eabc-0a05-4f9c-bbcd-4fa58427bc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:29.127587 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f925d0-287e-4afa-80d2-2a814c15db8b None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:29.205409 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 330/672] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:29.262376 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f925d0-287e-4afa-80d2-2a814c15db8b None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:29.275836 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:29.294630 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ee2b-5160-4f38-bd14-6119153dd6ac None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.294906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ee2b-5160-4f38-bd14-6119153dd6ac None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.295209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ee2b-5160-4f38-bd14-6119153dd6ac None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.297936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 331/673] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:49:29.298798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac3df-c836-42bc-baf9-def7e96a01f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:29.299405 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac3df-c836-42bc-baf9-def7e96a01f2 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.299687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac3df-c836-42bc-baf9-def7e96a01f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.299960 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac3df-c836-42bc-baf9-def7e96a01f2 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.300681 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac3df-c836-42bc-baf9-def7e96a01f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:29.302053 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac3df-c836-42bc-baf9-def7e96a01f2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:29.302353 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11344b-e132-4c3b-b9c2-e9003282f804 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.302828 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11344b-e132-4c3b-b9c2-e9003282f804 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.303294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11344b-e132-4c3b-b9c2-e9003282f804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.321762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-df11344b-e132-4c3b-b9c2-e9003282f804 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:29.323030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-df11344b-e132-4c3b-b9c2-e9003282f804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:29.385387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:29.389759 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 332/674] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 19 17:49:29.391022 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b9eb-5b7d-4f04-b2f0-762b3e637459 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.391303 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b9eb-5b7d-4f04-b2f0-762b3e637459 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.391571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5b9eb-5b7d-4f04-b2f0-762b3e637459 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.392923 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 333/675] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:29.398060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14d16-bbbf-41a8-a637-dc1ca674fd10 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.398342 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14d16-bbbf-41a8-a637-dc1ca674fd10 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.398613 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c14d16-bbbf-41a8-a637-dc1ca674fd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.418976 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-99c14d16-bbbf-41a8-a637-dc1ca674fd10 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:29.422708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-99c14d16-bbbf-41a8-a637-dc1ca674fd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:29.429956 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 343/676] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:49:29 2022] POST /identity/v3/services => generated 242 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:49:29.510419 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 334/677] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:29 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 19 17:49:29.573576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac3df-c836-42bc-baf9-def7e96a01f2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:29.680068 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac3df-c836-42bc-baf9-def7e96a01f2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:29.714650 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77f423-4918-49a5-bb72-100b20bae05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:29.715265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77f423-4918-49a5-bb72-100b20bae05a None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.715525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77f423-4918-49a5-bb72-100b20bae05a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.715799 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77f423-4918-49a5-bb72-100b20bae05a None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.716449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77f423-4918-49a5-bb72-100b20bae05a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:29.717920 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77f423-4918-49a5-bb72-100b20bae05a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:29.765839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c14d16-bbbf-41a8-a637-dc1ca674fd10 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:29.805699 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 344/678] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:49:29 2022] POST /identity/v3/services => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:49:29.845005 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77f423-4918-49a5-bb72-100b20bae05a None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:29.888843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c14d16-bbbf-41a8-a637-dc1ca674fd10 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:29.895163 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:29.921530 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:29.939533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6573-facc-4f57-9764-6cc88d319d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:29.940093 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6573-facc-4f57-9764-6cc88d319d46 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:29.940384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6573-facc-4f57-9764-6cc88d319d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:29.940654 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e6573-facc-4f57-9764-6cc88d319d46 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:29.941785 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e6573-facc-4f57-9764-6cc88d319d46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:29.943523 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e6573-facc-4f57-9764-6cc88d319d46 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:29.990184 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77f423-4918-49a5-bb72-100b20bae05a None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:30.028890 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e4ff3-0c54-40ce-94a0-a2f9f9c937a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:30.030335 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e4ff3-0c54-40ce-94a0-a2f9f9c937a8 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:30.030335 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e4ff3-0c54-40ce-94a0-a2f9f9c937a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:30.030335 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e4ff3-0c54-40ce-94a0-a2f9f9c937a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:30.042205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e4ff3-0c54-40ce-94a0-a2f9f9c937a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-f27e4ff3-0c54-40ce-94a0-a2f9f9c937a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:30.048225 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:30.050386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:30.051419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 345/679] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:49:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:30.055077 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e4ff3-0c54-40ce-94a0-a2f9f9c937a8 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:30.089936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 335/680] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:49:29 2022] POST /identity/v3/services => generated 251 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:49:30.171828 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:30.182512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e4ff3-0c54-40ce-94a0-a2f9f9c937a8 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:30.229240 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:30.229803 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:30.230080 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:30.230351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:30.231018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:30.231318 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:30.232726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:30.242975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 346/681] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:30.248550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6573-facc-4f57-9764-6cc88d319d46 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:30.363629 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e6573-facc-4f57-9764-6cc88d319d46 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:30.398809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:30.400056 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:30.400331 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:30.400596 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:30.411730 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:30.413252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:30.428015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:30.429035 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:30.430005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:30.430005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:30.430005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:30.430005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 336/682] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:30.436324 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:30.540978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44528631-1ccb-4bdd-8592-50df7a06b4a0 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:30.576397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:30.577009 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:30.577284 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:30.577581 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:30.578223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:30.578520 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:30.579900 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:30.593270 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 347/683] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:30.599047 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:30.638684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:30.713025 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08161-7d95-4d76-b616-4d54b6fbed65 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:30.749501 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:30.750507 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:30.750993 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:30.751470 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:30.760699 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:30.762483 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:30.774395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:30.775792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:30.776735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:30.779259 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 337/684] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Aug 19 17:49:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:30.785133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:30.806140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:30.891158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72f111-90ee-458f-b811-d608bf0a54b6 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:30.928024 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:30.928999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:30.929507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:30.930074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:30.931563 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:30.935401 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:30.935401 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:30.956886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 348/685] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Aug 19 17:49:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:30.962795 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:31.069373 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:31.077145 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ced949-f7d0-4b4c-bdc1-fca88de307cc None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:31.112751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dc839-8923-4079-b028-d657a5719644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:31.113763 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc839-8923-4079-b028-d657a5719644 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:31.114252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc839-8923-4079-b028-d657a5719644 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:31.114882 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dc839-8923-4079-b028-d657a5719644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:31.127378 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dc839-8923-4079-b028-d657a5719644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:31.129091 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dc839-8923-4079-b028-d657a5719644 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-486dc839-8923-4079-b028-d657a5719644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:31.144255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:31.145226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:31.146150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:31.146150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:31.146150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:31.148259 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 338/686] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:31.154210 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:31.223234 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:31.257678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e35e2e-cfb0-4126-be36-0e5cf7277b77 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:31.296504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:31.297117 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:31.297390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:31.297684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:31.298331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:31.298630 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:31.299991 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:31.313127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 349/687] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:31.318815 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dc839-8923-4079-b028-d657a5719644 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:31.428427 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dc839-8923-4079-b028-d657a5719644 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:31.464273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:31.465294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:31.465822 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:31.466301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:31.473567 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:31.475272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:31.487746 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:31.488706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:31.489667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:31.489667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:31.489667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:31.489667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:31.489667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:31.489667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:31.489667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:31.489667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:31.492123 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 339/688] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:31.499494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:31.603125 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4c02f-7ffb-4775-a39a-580a10a4a977 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:31.637557 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:31.645751 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cebe5-4a2e-4dd4-80a2-5109817f173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:31.646358 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cebe5-4a2e-4dd4-80a2-5109817f173a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:31.646650 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cebe5-4a2e-4dd4-80a2-5109817f173a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:31.646916 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cebe5-4a2e-4dd4-80a2-5109817f173a None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:31.647667 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cebe5-4a2e-4dd4-80a2-5109817f173a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:31.647941 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cebe5-4a2e-4dd4-80a2-5109817f173a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:31.649517 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cebe5-4a2e-4dd4-80a2-5109817f173a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:31.662646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 350/689] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:31.668193 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:31.692183 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:31.775507 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704a42f-6e32-4270-8231-bdad8349be82 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:31.781707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fceb-b8da-4667-ae0e-a641e7699ad1 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:31.781994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fceb-b8da-4667-ae0e-a641e7699ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:31.782269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271fceb-b8da-4667-ae0e-a641e7699ad1 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:31.783902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 351/690] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:31.789077 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae615e8-74a0-4744-9557-4eeb43e5a32b None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:31.790412 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae615e8-74a0-4744-9557-4eeb43e5a32b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:31.790412 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae615e8-74a0-4744-9557-4eeb43e5a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:31.808493 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-6ae615e8-74a0-4744-9557-4eeb43e5a32b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:31.809709 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-6ae615e8-74a0-4744-9557-4eeb43e5a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:31.812229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7c329-e971-4797-b647-0605fd435a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:31.812993 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c329-e971-4797-b647-0605fd435a85 None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:31.813281 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c329-e971-4797-b647-0605fd435a85 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:31.813603 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7c329-e971-4797-b647-0605fd435a85 None admin] PATH_INFO: `/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/cbf8fe29550b480dbb5294af4dc962c6/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:31.815540 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c329-e971-4797-b647-0605fd435a85 None admin] RBAC: Authorizing `identity:create_grant(project_id=0faa0bfd1ad0406eb336f391d6846bbd, user_id=cbf8fe29550b480dbb5294af4dc962c6, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:31.816991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7c329-e971-4797-b647-0605fd435a85 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:31.876837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 340/691] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:49:31 2022] PUT /identity/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/cbf8fe29550b480dbb5294af4dc962c6/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:49:31.893642 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 352/692] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:49:32.136068 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5d744-41d1-4b32-9b4e-ee591da2daf6 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.136475 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5d744-41d1-4b32-9b4e-ee591da2daf6 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.136645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5d744-41d1-4b32-9b4e-ee591da2daf6 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.138255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 341/693] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:32.143577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdefca-7554-46ce-a98f-77882e9f47e2 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.143865 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdefca-7554-46ce-a98f-77882e9f47e2 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.144137 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdefca-7554-46ce-a98f-77882e9f47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.163370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-cdcdefca-7554-46ce-a98f-77882e9f47e2 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:32.164552 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-cdcdefca-7554-46ce-a98f-77882e9f47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:32.222814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5d744-41d1-4b32-9b4e-ee591da2daf6 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:32.247861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 353/694] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:32.296561 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:32.332669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5d744-41d1-4b32-9b4e-ee591da2daf6 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:32.367779 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:32.368600 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.368880 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.369151 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] PATH_INFO: `/v3/services/image` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.369765 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:32.371123 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:32.380030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:32.382344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:32.384684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:32.386520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 342/695] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Aug 19 17:49:32 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:32.393439 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdefca-7554-46ce-a98f-77882e9f47e2 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:32.450051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:32.502106 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdefca-7554-46ce-a98f-77882e9f47e2 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:32.542278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:32.542887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.543161 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.543435 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.544065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] RBAC: Adding query filter params (name=image) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:32.544364 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:32.545783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:32.555122 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 354/696] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:32.556749 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:32.583645 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:32.662541 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cb1d8-2a5b-4efd-88c1-543853cefe06 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:32.691012 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:32.697394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17a43c-b217-4280-989b-31c24d1e9dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:32.698041 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a43c-b217-4280-989b-31c24d1e9dc2 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.698309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a43c-b217-4280-989b-31c24d1e9dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.698583 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17a43c-b217-4280-989b-31c24d1e9dc2 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.699264 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17a43c-b217-4280-989b-31c24d1e9dc2 None admin] RBAC: Adding query filter params (type=image) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:32.699563 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17a43c-b217-4280-989b-31c24d1e9dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:32.700928 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17a43c-b217-4280-989b-31c24d1e9dc2 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:32.709508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 343/697] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:32.709508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1f5c-83d1-46fc-a193-b966f71da27a None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.709750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed3b87-506b-4346-8f2c-62fdaadf6741 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:32.709838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1f5c-83d1-46fc-a193-b966f71da27a None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.709838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c1f5c-83d1-46fc-a193-b966f71da27a None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.709838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 344/698] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:32.712216 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c1f5c-83d1-46fc-a193-b966f71da27a None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:32.723507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:32.746990 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3c5f0-8862-446e-be8a-635d32474985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:32.747640 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3c5f0-8862-446e-be8a-635d32474985 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.747916 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3c5f0-8862-446e-be8a-635d32474985 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.748186 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3c5f0-8862-446e-be8a-635d32474985 None admin] PATH_INFO: `/v3/services/network` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.748756 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3c5f0-8862-446e-be8a-635d32474985 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:32.750158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3c5f0-8862-446e-be8a-635d32474985 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-cbf3c5f0-8862-446e-be8a-635d32474985 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:32.759346 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:32.766301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:32.767142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 355/699] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:32 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:32.767944 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2e72a-6f53-4752-b2e7-9fa7386e95d7 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.767944 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2e72a-6f53-4752-b2e7-9fa7386e95d7 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.767944 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2e72a-6f53-4752-b2e7-9fa7386e95d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.785038 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-dbd2e72a-6f53-4752-b2e7-9fa7386e95d7 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:32.786496 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-dbd2e72a-6f53-4752-b2e7-9fa7386e95d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:32.831955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c1f5c-83d1-46fc-a193-b966f71da27a None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:32.865371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 356/700] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:32 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:32.867137 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2e72a-6f53-4752-b2e7-9fa7386e95d7 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:32.887436 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:32.888610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:32.888996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:32.889329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:32.890203 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] RBAC: Adding query filter params (interface=public, service_id=095c2f2799a748c0aea97596d09964ba, region_id=RegionOne) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:32.893056 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:32.893056 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:32.908325 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 345/701] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Aug 19 17:49:32 2022] GET /identity/v3/endpoints?service_id=095c2f2799a748c0aea97596d09964ba&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:32.909399 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:32.988369 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:32.988724 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2e72a-6f53-4752-b2e7-9fa7386e95d7 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.001861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:33.031664 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.032583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.033056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.033618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.034463 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] RBAC: Adding query filter params (name=network) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:33.034903 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.036814 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.044229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d93d-b79d-4288-a0db-360c60cb9939 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.048150 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 357/702] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:33.048473 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:33.094759 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace72c6-4ab1-495a-b965-0327741a3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.095710 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace72c6-4ab1-495a-b965-0327741a3c1e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.096232 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace72c6-4ab1-495a-b965-0327741a3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.096705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace72c6-4ab1-495a-b965-0327741a3c1e None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.097538 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace72c6-4ab1-495a-b965-0327741a3c1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.099182 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace72c6-4ab1-495a-b965-0327741a3c1e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.106039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 346/703] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Aug 19 17:49:32 2022] GET /identity/v3/services => generated 1002 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:49:33.168784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adda47c-00e2-49e4-ae1c-721843931551 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.197097 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace72c6-4ab1-495a-b965-0327741a3c1e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:33.215223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.215845 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.216121 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.216391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.217131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] RBAC: Adding query filter params (type=network) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:33.217477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.218991 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.225049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 358/704] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:33.232293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:33.272632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:33.327482 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace72c6-4ab1-495a-b965-0327741a3c1e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.353984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:33.362856 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9a60d-b910-4f35-97df-871301f1ee5e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.368319 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.368957 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.371910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.371910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.371910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.371910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:33.382662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:33.384514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:33.385575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 347/705] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Aug 19 17:49:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:33.390712 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:33.409390 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.410036 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.410317 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.410592 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.411554 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] RBAC: Adding query filter params (interface=public, service_id=42fa1b92326a4a36bce704a0ad70ec24, region_id=RegionOne) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:33.411867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.413240 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.421472 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 359/706] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Aug 19 17:49:33 2022] GET /identity/v3/endpoints?service_id=42fa1b92326a4a36bce704a0ad70ec24&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:33.426576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:33.509384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815e153-0ac6-403d-bd5a-329cbee6570f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.545943 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.546617 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.546992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.547363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.547735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12ba4c-dcda-454b-95f9-01b53e9543d2 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.548192 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:33.548594 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.550124 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.555466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 348/707] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Aug 19 17:49:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:33.556793 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:33.560729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:33.591973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ee5c-d1e8-440c-abed-c7f18f98bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.592641 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ee5c-d1e8-440c-abed-c7f18f98bb7c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.593080 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ee5c-d1e8-440c-abed-c7f18f98bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.593367 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724ee5c-d1e8-440c-abed-c7f18f98bb7c None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.594066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724ee5c-d1e8-440c-abed-c7f18f98bb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.596134 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724ee5c-d1e8-440c-abed-c7f18f98bb7c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.609440 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 360/708] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Aug 19 17:49:33 2022] GET /identity/v3/services => generated 1002 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:49:33.621842 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:33.680073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89c2d0-6d5d-405c-9fbb-b105404115ee None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.718586 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.719263 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.719551 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.719827 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.720476 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:33.720780 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.722584 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.728928 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 349/709] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Aug 19 17:49:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:33.738639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ee5c-d1e8-440c-abed-c7f18f98bb7c None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:33.857356 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724ee5c-d1e8-440c-abed-c7f18f98bb7c None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:33.893674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e426c-faad-40c1-91ed-d0b4d6507459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:33.894971 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e426c-faad-40c1-91ed-d0b4d6507459 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:33.897659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e426c-faad-40c1-91ed-d0b4d6507459 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:33.897659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e426c-faad-40c1-91ed-d0b4d6507459 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:33.897659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e426c-faad-40c1-91ed-d0b4d6507459 None admin] RBAC: Adding query filter params (interface=public, service_id=4a4ef708dd804daba464026e89ca3531, region_id=RegionOne) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:33.897659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e426c-faad-40c1-91ed-d0b4d6507459 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:33.898739 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e426c-faad-40c1-91ed-d0b4d6507459 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:33.904975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 361/710] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Aug 19 17:49:33 2022] GET /identity/v3/endpoints?service_id=4a4ef708dd804daba464026e89ca3531&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:33.910313 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:34.019412 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0676-b30e-40cb-aafd-6aa25c11991a None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:34.034420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:34.054892 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93e51b-df47-4319-9d4f-df09e6010cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:34.055529 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e51b-df47-4319-9d4f-df09e6010cbb None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:34.055814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e51b-df47-4319-9d4f-df09e6010cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:34.056088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93e51b-df47-4319-9d4f-df09e6010cbb None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:34.056695 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93e51b-df47-4319-9d4f-df09e6010cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:34.058131 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93e51b-df47-4319-9d4f-df09e6010cbb None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:34.063954 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 350/711] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Aug 19 17:49:33 2022] GET /identity/v3/services => generated 1002 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:49:34.256504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d2ef1-6f2a-4480-b3dd-aed22d845ea5 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:34.257152 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d2ef1-6f2a-4480-b3dd-aed22d845ea5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:34.257690 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d2ef1-6f2a-4480-b3dd-aed22d845ea5 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:34.260163 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 362/712] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:34.265679 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62439f3-ff3e-4a67-9b05-6a9fc91c8a2c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:34.266233 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62439f3-ff3e-4a67-9b05-6a9fc91c8a2c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:34.266711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62439f3-ff3e-4a67-9b05-6a9fc91c8a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:34.286512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-a62439f3-ff3e-4a67-9b05-6a9fc91c8a2c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:34.288019 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-a62439f3-ff3e-4a67-9b05-6a9fc91c8a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:34.362083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 351/713] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:34.697520 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d2ef1-6f2a-4480-b3dd-aed22d845ea5 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:34.726959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:34.809590 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d2ef1-6f2a-4480-b3dd-aed22d845ea5 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:34.845631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848757b8-4234-4d28-9392-bd8b4d779065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:34.846682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848757b8-4234-4d28-9392-bd8b4d779065 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:34.847193 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848757b8-4234-4d28-9392-bd8b4d779065 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:34.847666 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848757b8-4234-4d28-9392-bd8b4d779065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:34.860462 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848757b8-4234-4d28-9392-bd8b4d779065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-848757b8-4234-4d28-9392-bd8b4d779065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:49:34.865452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:34.866392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:49:34.867249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:34.869856 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 363/714] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:34.875866 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62439f3-ff3e-4a67-9b05-6a9fc91c8a2c None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:34.982167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62439f3-ff3e-4a67-9b05-6a9fc91c8a2c None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:34.992549 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:35.018233 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:35.018837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.019113 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.019380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.020033 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:35.020330 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:35.021777 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:35.031251 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 352/715] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:35.042126 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848757b8-4234-4d28-9392-bd8b4d779065 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:35.132335 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:35.147849 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848757b8-4234-4d28-9392-bd8b4d779065 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:35.184096 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:35.184745 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.185355 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.185665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.197654 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:35.199189 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:35.215780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:35.216772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:35.218341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:35.218341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:35.218341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:35.218341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 364/716] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:35.223005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:35.342044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6bc30-24d6-4ae1-8cab-11b757e5a3ae None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:35.383733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff78b6-244f-4867-991c-b551aa2b0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:35.384740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff78b6-244f-4867-991c-b551aa2b0491 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.385232 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff78b6-244f-4867-991c-b551aa2b0491 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.385702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff78b6-244f-4867-991c-b551aa2b0491 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.386643 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff78b6-244f-4867-991c-b551aa2b0491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:35.387128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff78b6-244f-4867-991c-b551aa2b0491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:35.388757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff78b6-244f-4867-991c-b551aa2b0491 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:35.402373 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 353/717] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:35.408598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:35.420481 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0341c-8ca9-408a-a15f-0b34d7cd94b8 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.420774 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0341c-8ca9-408a-a15f-0b34d7cd94b8 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.421032 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0341c-8ca9-408a-a15f-0b34d7cd94b8 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.422628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 354/718] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:35.433073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6314004-2dbf-496e-b80d-ed0c3482d2d6 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.433385 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6314004-2dbf-496e-b80d-ed0c3482d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.433660 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6314004-2dbf-496e-b80d-ed0c3482d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.458717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e6314004-2dbf-496e-b80d-ed0c3482d2d6 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:35.460155 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e6314004-2dbf-496e-b80d-ed0c3482d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:35.506800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:35.529735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50760d6-bd7e-4063-99a5-9f5c9f317b88 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:35.565410 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:35.565916 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 355/719] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:35 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:49:35.566523 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.566951 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.567367 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.576175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:35.577993 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:35.579903 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:35.590722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:35.592224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 19 17:49:35.593486 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:35.595533 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 365/720] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Aug 19 17:49:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:35.601449 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6314004-2dbf-496e-b80d-ed0c3482d2d6 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:35.710413 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6314004-2dbf-496e-b80d-ed0c3482d2d6 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:35.749303 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93994f47-4175-4b2a-b1a1-abb15e3d3362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:35.749971 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994f47-4175-4b2a-b1a1-abb15e3d3362 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.750249 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994f47-4175-4b2a-b1a1-abb15e3d3362 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.750523 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994f47-4175-4b2a-b1a1-abb15e3d3362 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.751276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93994f47-4175-4b2a-b1a1-abb15e3d3362 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:35.751584 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93994f47-4175-4b2a-b1a1-abb15e3d3362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:35.753077 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93994f47-4175-4b2a-b1a1-abb15e3d3362 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:35.774931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 356/721] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Aug 19 17:49:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:35.780742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:35.888765 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665bf99-1aa9-4ea3-a6d7-b1480e62c0e7 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:35.910519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8523c-af70-4ed1-b0ef-d8e6c763bf4c None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.910743 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8523c-af70-4ed1-b0ef-d8e6c763bf4c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.911010 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8523c-af70-4ed1-b0ef-d8e6c763bf4c None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.912885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 357/722] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:35.917911 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902f70-982c-4fff-a6e2-b529fdb3fafd None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.918193 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902f70-982c-4fff-a6e2-b529fdb3fafd None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.918470 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15902f70-982c-4fff-a6e2-b529fdb3fafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.927625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b781a6-38c0-477c-9847-f898e2099e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:35.928591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b781a6-38c0-477c-9847-f898e2099e18 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:35.929071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b781a6-38c0-477c-9847-f898e2099e18 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:35.929578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b781a6-38c0-477c-9847-f898e2099e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:35.938294 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-15902f70-982c-4fff-a6e2-b529fdb3fafd None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:35.939506 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-15902f70-982c-4fff-a6e2-b529fdb3fafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:35.954719 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.001023 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.005006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b781a6-38c0-477c-9847-f898e2099e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.006515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b781a6-38c0-477c-9847-f898e2099e18 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.010299 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 358/723] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:35 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:49:36.014408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902f70-982c-4fff-a6e2-b529fdb3fafd None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.124354 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15902f70-982c-4fff-a6e2-b529fdb3fafd None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.140962 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 366/724] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:35 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:49:36.141730 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b781a6-38c0-477c-9847-f898e2099e18 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.172740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.174058 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.174804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.175282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] PATH_INFO: `/v3/services/image` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.176742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.178327 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:36.190172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:36.191243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 19 17:49:36.192107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:36.196841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 359/725] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:36.200743 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.218001 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.261491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.266881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b781a6-38c0-477c-9847-f898e2099e18 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.307958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.308978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.309546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.310151 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.313288 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2419ec-e0c2-4b2e-bcad-273dd99d8276 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.321740 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.323634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:36.340589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:36.341663 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:36.342578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:36.342578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:36.342578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:36.344484 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 367/726] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:36.345563 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.349070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.349707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.349989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.350266 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.350896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] RBAC: Adding query filter params (name=image) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:36.351208 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.353278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.361572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 360/727] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:36.363414 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.442103 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.451065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348976f6-d69d-4e76-b2ee-dd4ea1783d00 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.464220 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62808c7-93f8-4acd-aaeb-792ee44f6ed4 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.485331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.485999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.486280 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.486556 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] PATH_INFO: `/v3/services/network` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.487142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.488582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:36.497821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:36.499043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:36.500052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 368/728] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/services/network => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:36.501028 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.507071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3533b-c638-46a3-b668-ea7175d488b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.507688 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3533b-c638-46a3-b668-ea7175d488b1 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.507972 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3533b-c638-46a3-b668-ea7175d488b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.508245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3533b-c638-46a3-b668-ea7175d488b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.508982 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3533b-c638-46a3-b668-ea7175d488b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:36.509282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3533b-c638-46a3-b668-ea7175d488b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.511097 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3533b-c638-46a3-b668-ea7175d488b1 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.516969 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.523921 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 361/729] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:36.525333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4e9f0-ac5e-451f-984b-1e729b659e95 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.525697 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4e9f0-ac5e-451f-984b-1e729b659e95 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.526034 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4e9f0-ac5e-451f-984b-1e729b659e95 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.527370 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 362/730] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:36.528239 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4e9f0-ac5e-451f-984b-1e729b659e95 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.605887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bbe8-a0dd-4ace-9e70-fd9e2daeec24 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.629626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4e9f0-ac5e-451f-984b-1e729b659e95 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.639655 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.640257 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.640540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.640817 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.641461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] RBAC: Adding query filter params (type=image) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:36.641772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.643148 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.647821 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 369/731] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:36.648594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.665776 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8285644-14c6-455d-bc51-1d6856b0dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.666443 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8285644-14c6-455d-bc51-1d6856b0dd26 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.667045 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8285644-14c6-455d-bc51-1d6856b0dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.667045 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8285644-14c6-455d-bc51-1d6856b0dd26 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.667588 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8285644-14c6-455d-bc51-1d6856b0dd26 None admin] RBAC: Adding query filter params (name=network) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:36.667888 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8285644-14c6-455d-bc51-1d6856b0dd26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.669235 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8285644-14c6-455d-bc51-1d6856b0dd26 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.670982 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.674182 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 363/732] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:36.675312 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4b54b-2416-457d-81a2-b2180856ed48 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.675592 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4b54b-2416-457d-81a2-b2180856ed48 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.675860 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4b54b-2416-457d-81a2-b2180856ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.693194 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-10f4b54b-2416-457d-81a2-b2180856ed48 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:36.694351 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-10f4b54b-2416-457d-81a2-b2180856ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:36.730539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.751325 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f404bb8-2759-4724-b71b-0757159a90b5 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.761801 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 364/733] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:36 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:36.762623 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4b54b-2416-457d-81a2-b2180856ed48 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.797863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.798499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.798779 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.799055 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.807022 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.808470 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:36.820388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:36.822312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 370/734] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:36.823243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.869860 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4b54b-2416-457d-81a2-b2180856ed48 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.902199 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:36.908015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34644c7-dc27-4be0-8376-8fae4cc69095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.908723 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34644c7-dc27-4be0-8376-8fae4cc69095 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.908906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34644c7-dc27-4be0-8376-8fae4cc69095 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.909162 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34644c7-dc27-4be0-8376-8fae4cc69095 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.909843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34644c7-dc27-4be0-8376-8fae4cc69095 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.911485 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34644c7-dc27-4be0-8376-8fae4cc69095 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.928037 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f648f2-15f4-4e6b-b80f-6b0f88a6c713 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:36.962226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:36.962630 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:36.962910 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:36.963185 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:36.963809 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] RBAC: Adding query filter params (type=network) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:36.964113 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:36.965503 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:36.970220 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 371/735] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:36.971000 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:36.978233 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:37.004876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 365/736] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 17:49:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:37.005972 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34644c7-dc27-4be0-8376-8fae4cc69095 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:37.098562 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8d4b0-4100-4418-9353-dba252bacb6f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:37.145697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:37.146356 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:37.146614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:37.146886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:37.147582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:37.147887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:37.150011 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:37.153235 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34644c7-dc27-4be0-8376-8fae4cc69095 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:37.166342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 372/737] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:37.167237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:37.196602 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319a0bc-bfc8-4f50-927c-1ed6da9ecf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:37.197754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a0bc-bfc8-4f50-927c-1ed6da9ecf22 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:37.198186 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a0bc-bfc8-4f50-927c-1ed6da9ecf22 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:37.198466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319a0bc-bfc8-4f50-927c-1ed6da9ecf22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:37.199130 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319a0bc-bfc8-4f50-927c-1ed6da9ecf22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:37.200514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319a0bc-bfc8-4f50-927c-1ed6da9ecf22 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:37.233926 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:37.279634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a244473-1073-4f19-8e71-aab22362e2ab None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:37.280187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 366/738] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 17:49:37 2022] POST /identity/v3/endpoints => generated 337 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:37.281039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319a0bc-bfc8-4f50-927c-1ed6da9ecf22 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:37.338623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:37.339560 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:37.340242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:37.340662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:37.342384 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:37.344073 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:37.351979 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:37.356546 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:37.363585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:37.364668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 373/739] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Aug 19 17:49:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:37.365769 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:37.442538 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319a0bc-bfc8-4f50-927c-1ed6da9ecf22 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:37.500317 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:37.500927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:37.501201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:37.501535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:37.503020 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=cbf8fe29550b480dbb5294af4dc962c6) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:37.503326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:37.504766 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:37.510935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795441c-c8a3-441e-9842-b43bd8cf1ac7 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:37.512188 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 367/740] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:49:37 2022] GET /identity/v3/role_assignments?user.id=cbf8fe29550b480dbb5294af4dc962c6&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=757702b4209942a3b2ec7bf21d995169 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:37.532142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:37.557145 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:37.557925 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:37.558215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:37.558479 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:37.559127 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:37.559428 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:37.560988 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:37.568386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 374/741] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Aug 19 17:49:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:37.575196 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:37.694577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6c5d-258c-4b42-9dee-f23f313a5a37 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:37.703449 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:37.731091 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21338a8-a247-40b1-a888-0f3c8beff7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:37.731711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21338a8-a247-40b1-a888-0f3c8beff7f4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:37.732151 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21338a8-a247-40b1-a888-0f3c8beff7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:37.732531 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21338a8-a247-40b1-a888-0f3c8beff7f4 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:37.733670 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21338a8-a247-40b1-a888-0f3c8beff7f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:37.734314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21338a8-a247-40b1-a888-0f3c8beff7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:37.735708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21338a8-a247-40b1-a888-0f3c8beff7f4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:37.741189 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 368/742] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Aug 19 17:49:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:37.747309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:37.854845 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd0e45-cbb3-46c8-abb9-b2652697247d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:37.894222 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be16074-c4cb-468a-8b64-a7108b0995c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:37.894834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16074-c4cb-468a-8b64-a7108b0995c3 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:37.895114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16074-c4cb-468a-8b64-a7108b0995c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:37.895447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be16074-c4cb-468a-8b64-a7108b0995c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:37.896108 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be16074-c4cb-468a-8b64-a7108b0995c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:37.897504 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be16074-c4cb-468a-8b64-a7108b0995c3 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:37.993652 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 375/743] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 17:49:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:39.281831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668404f4-dc61-49dd-90a4-c071d28dd634 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:39.282380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668404f4-dc61-49dd-90a4-c071d28dd634 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:39.282380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668404f4-dc61-49dd-90a4-c071d28dd634 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:39.283973 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 369/744] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:39.289230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5043-0e6d-4366-8eaa-1b090f14ec6b None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:39.289653 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5043-0e6d-4366-8eaa-1b090f14ec6b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:39.290349 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd5043-0e6d-4366-8eaa-1b090f14ec6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:39.308819 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-08cd5043-0e6d-4366-8eaa-1b090f14ec6b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:39.310035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-08cd5043-0e6d-4366-8eaa-1b090f14ec6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:39.340262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:39.384398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 376/745] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:39 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:39.711286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668404f4-dc61-49dd-90a4-c071d28dd634 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:39.751240 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca5f2-4b7f-48d1-81b3-b1cdb9b9ea18 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:39.751591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca5f2-4b7f-48d1-81b3-b1cdb9b9ea18 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:39.751794 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ca5f2-4b7f-48d1-81b3-b1cdb9b9ea18 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:39.753279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 377/746] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:39.757953 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a020901-543c-4206-836c-b6ed560d1e43 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:39.758237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a020901-543c-4206-836c-b6ed560d1e43 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:39.758841 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a020901-543c-4206-836c-b6ed560d1e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:39.778052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-5a020901-543c-4206-836c-b6ed560d1e43 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:39.779236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-5a020901-543c-4206-836c-b6ed560d1e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:39.818310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668404f4-dc61-49dd-90a4-c071d28dd634 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:39.853523 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 378/747] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:39 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:49:39.854929 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1490c64-8418-4f64-85e6-be554a6bb73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:39.855706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1490c64-8418-4f64-85e6-be554a6bb73e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:39.856155 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1490c64-8418-4f64-85e6-be554a6bb73e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:39.856589 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1490c64-8418-4f64-85e6-be554a6bb73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:40.020043 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:40.051855 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1490c64-8418-4f64-85e6-be554a6bb73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:40.053667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1490c64-8418-4f64-85e6-be554a6bb73e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:40.154878 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 370/748] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:49:39 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:49:40.160466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a020901-543c-4206-836c-b6ed560d1e43 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:40.180901 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1490c64-8418-4f64-85e6-be554a6bb73e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:40.250967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:40.260704 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:40.266936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a020901-543c-4206-836c-b6ed560d1e43 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:40.282540 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1490c64-8418-4f64-85e6-be554a6bb73e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:40.300249 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08325853-0a97-4860-949a-1190f35d94d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:40.300866 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325853-0a97-4860-949a-1190f35d94d4 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:40.301140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325853-0a97-4860-949a-1190f35d94d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:40.301408 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08325853-0a97-4860-949a-1190f35d94d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:40.311743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08325853-0a97-4860-949a-1190f35d94d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:40.313201 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08325853-0a97-4860-949a-1190f35d94d4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:40.315841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:40.316473 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:40.316753 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:40.317310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:40.317711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:40.319049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-08325853-0a97-4860-949a-1190f35d94d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:49:40.328205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:40.329175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:49:40.330253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:49:40.330253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:49:40.330253 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:40.330784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:40.331628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:40.332514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:40.333294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 379/749] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:49:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:40.333371 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 371/750] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Aug 19 17:49:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:40.335101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53def90-52fc-4b43-ae65-8114d76a404e None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:40.335382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53def90-52fc-4b43-ae65-8114d76a404e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:40.335503 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:40.335658 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53def90-52fc-4b43-ae65-8114d76a404e None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:40.337764 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 380/751] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:40.338712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53def90-52fc-4b43-ae65-8114d76a404e None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:40.436702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9749a3-7125-478a-a227-a45694a95bbd None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:40.442479 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53def90-52fc-4b43-ae65-8114d76a404e None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:40.469780 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be273cf-eb1d-4e9b-9383-cf709b5c8876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:40.470385 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be273cf-eb1d-4e9b-9383-cf709b5c8876 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:40.470665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be273cf-eb1d-4e9b-9383-cf709b5c8876 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:40.470937 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be273cf-eb1d-4e9b-9383-cf709b5c8876 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:40.471555 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be273cf-eb1d-4e9b-9383-cf709b5c8876 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:40.471861 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be273cf-eb1d-4e9b-9383-cf709b5c8876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:40.473262 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be273cf-eb1d-4e9b-9383-cf709b5c8876 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:40.474369 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:40.475634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:40.476229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:40.476500 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:40.476765 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:40.477483 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:40.478025 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:40.478706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 372/752] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Aug 19 17:49:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:40.479983 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18456eb-4fc2-4210-8371-7c4638e9c667 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:40.480268 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18456eb-4fc2-4210-8371-7c4638e9c667 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:40.480541 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18456eb-4fc2-4210-8371-7c4638e9c667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:40.484890 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:40.497104 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 381/753] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:40.497977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:40.506706 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:40.512034 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e18456eb-4fc2-4210-8371-7c4638e9c667 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:40.513674 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e18456eb-4fc2-4210-8371-7c4638e9c667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:40.594945 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 373/754] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:40 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:40.619952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b9175-e8d3-4b63-a569-7888b53b77fb None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:40.659735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:40.660355 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:40.660634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:40.660908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:40.661834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:40.662139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:40.663534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:40.677686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 382/755] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Aug 19 17:49:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:40.926058 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18456eb-4fc2-4210-8371-7c4638e9c667 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:41.026533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18456eb-4fc2-4210-8371-7c4638e9c667 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:41.053482 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:41.062420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:41.062420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:41.062718 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:41.062990 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:41.066120 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:41.066120 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:41.073856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:41.074835 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:41.075701 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 374/756] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:41.080919 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:41.150374 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:41.181879 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319b71e-f738-4db8-92bb-a69bea6a0f8e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:41.214847 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45958878-ce68-47d1-9924-eb1b9ad1af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:41.215449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45958878-ce68-47d1-9924-eb1b9ad1af51 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:41.215726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45958878-ce68-47d1-9924-eb1b9ad1af51 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:41.215993 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45958878-ce68-47d1-9924-eb1b9ad1af51 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:41.216607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45958878-ce68-47d1-9924-eb1b9ad1af51 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:41.216908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45958878-ce68-47d1-9924-eb1b9ad1af51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:41.218303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45958878-ce68-47d1-9924-eb1b9ad1af51 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:41.222884 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 383/757] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:41.228466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:41.328439 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d2be6-dce6-4753-84fd-06cd14f09a38 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:41.361587 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ddcea-6be3-4acb-b96e-0b46009a8198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:41.362187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ddcea-6be3-4acb-b96e-0b46009a8198 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:41.362463 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ddcea-6be3-4acb-b96e-0b46009a8198 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:41.362736 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ddcea-6be3-4acb-b96e-0b46009a8198 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:41.363361 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ddcea-6be3-4acb-b96e-0b46009a8198 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:41.363662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ddcea-6be3-4acb-b96e-0b46009a8198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:41.365024 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ddcea-6be3-4acb-b96e-0b46009a8198 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:41.370168 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 375/758] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:42.860719 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1e89-a291-4499-be6c-439699418969 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:42.861243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1e89-a291-4499-be6c-439699418969 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:42.861349 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f1e89-a291-4499-be6c-439699418969 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:42.862693 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 384/759] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:42.868154 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6ae40-dac1-431a-8187-63ed291673bb None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:42.868776 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6ae40-dac1-431a-8187-63ed291673bb None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:42.868776 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6ae40-dac1-431a-8187-63ed291673bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:42.886895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d9c6ae40-dac1-431a-8187-63ed291673bb None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:42.888083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d9c6ae40-dac1-431a-8187-63ed291673bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:42.938902 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:42.955681 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 376/760] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:42 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:43.285178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f1e89-a291-4499-be6c-439699418969 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:43.389364 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f1e89-a291-4499-be6c-439699418969 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:43.546681 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264d2ed-a283-470c-a38b-3ff18a7b60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:43.547215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d2ed-a283-470c-a38b-3ff18a7b60dc None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:43.547496 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d2ed-a283-470c-a38b-3ff18a7b60dc None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:43.547769 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264d2ed-a283-470c-a38b-3ff18a7b60dc None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:43.548409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264d2ed-a283-470c-a38b-3ff18a7b60dc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:43.549810 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264d2ed-a283-470c-a38b-3ff18a7b60dc None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:43.553157 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:43.554132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98485-a734-4ea1-afd0-ebd38425971c None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:43.554476 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98485-a734-4ea1-afd0-ebd38425971c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:43.554816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a98485-a734-4ea1-afd0-ebd38425971c None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:43.556841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 377/761] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:49:43.561875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205535-d01a-426e-9dad-7bfe7907cc2d None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:43.562153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205535-d01a-426e-9dad-7bfe7907cc2d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:43.562480 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28205535-d01a-426e-9dad-7bfe7907cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:43.580673 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-28205535-d01a-426e-9dad-7bfe7907cc2d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:43.581873 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-28205535-d01a-426e-9dad-7bfe7907cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:43.646450 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 378/762] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:43 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:49:43.659314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 385/763] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:49:43 2022] POST /identity/v3/services => generated 269 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:43.978966 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28205535-d01a-426e-9dad-7bfe7907cc2d None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:44.077781 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28205535-d01a-426e-9dad-7bfe7907cc2d None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:44.094612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:44.127703 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498df1a2-15cf-4b63-8b8d-c01e9865e78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:44.128314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df1a2-15cf-4b63-8b8d-c01e9865e78a None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:44.128594 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df1a2-15cf-4b63-8b8d-c01e9865e78a None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:44.128866 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498df1a2-15cf-4b63-8b8d-c01e9865e78a None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:44.129563 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498df1a2-15cf-4b63-8b8d-c01e9865e78a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:44.130925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498df1a2-15cf-4b63-8b8d-c01e9865e78a None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:44.221841 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 379/764] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:49:43 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:49:45.874840 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6783-cc69-49a8-906d-0d572d9c34f3 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:45.875360 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6783-cc69-49a8-906d-0d572d9c34f3 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:45.875449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6783-cc69-49a8-906d-0d572d9c34f3 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:45.876711 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 386/765] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:45.882076 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359562-47b8-40a1-ab70-52652cbd187d None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:45.882505 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359562-47b8-40a1-ab70-52652cbd187d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:45.882770 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359562-47b8-40a1-ab70-52652cbd187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:45.901624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-6c359562-47b8-40a1-ab70-52652cbd187d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:45.902797 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-6c359562-47b8-40a1-ab70-52652cbd187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:45.976741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 380/766] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:45 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:46.320091 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa6783-cc69-49a8-906d-0d572d9c34f3 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:46.420177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa6783-cc69-49a8-906d-0d572d9c34f3 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:46.449452 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddbe51-c05f-4feb-8344-2aa142761ddc None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:46.449733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddbe51-c05f-4feb-8344-2aa142761ddc None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:46.450005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddbe51-c05f-4feb-8344-2aa142761ddc None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:46.451546 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 381/767] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:46.453641 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:46.454267 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:46.454542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:46.454808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:46.455392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:46.456175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3946f21-39a9-4365-8282-8a6a8c788130 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:46.456456 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3946f21-39a9-4365-8282-8a6a8c788130 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:46.456731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3946f21-39a9-4365-8282-8a6a8c788130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:46.456837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:46.466006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:46.467101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:46.468577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 387/768] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Aug 19 17:49:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:46.472767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:46.474642 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e3946f21-39a9-4365-8282-8a6a8c788130 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:46.475826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e3946f21-39a9-4365-8282-8a6a8c788130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:46.533251 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:46.546914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 382/769] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:46 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:49:46.574818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fd861-0f0b-4675-a958-05a75e7c1a9f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:46.607433 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:46.608036 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:46.608314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:46.608586 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:46.609214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:46.609554 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:46.610925 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:46.615460 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 388/770] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Aug 19 17:49:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:46.622219 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3946f21-39a9-4365-8282-8a6a8c788130 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:46.650129 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:46.721268 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3946f21-39a9-4365-8282-8a6a8c788130 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:46.754917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:46.755571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:46.755842 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:46.756108 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:46.756734 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:46.757031 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:46.758426 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:46.764418 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 383/771] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Aug 19 17:49:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:46.769507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:46.867268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee19a9c-8aab-4100-9b10-ab02974e958b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:46.882724 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:46.891931 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:46.903808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:46.904413 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:46.904697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:46.904976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:46.905732 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] RBAC: Adding query filter params (interface=public, service_id=10af2bafcc7c433ba0cef55ee0b6a1a1, region_id=RegionOne) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:46.906043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:46.907414 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:46.912568 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 389/772] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Aug 19 17:49:46 2022] GET /identity/v3/endpoints?service_id=10af2bafcc7c433ba0cef55ee0b6a1a1&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:46.918371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:46.976319 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:46.984854 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18025e0-808f-479b-9bdd-1eafae6b49d7 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:47.017591 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23ccf-8420-4e89-a45b-a8101353b7bb None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:47.019135 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:47.019764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:47.020042 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:47.020313 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:47.020888 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:47.022286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:47.031640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:47.032693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:47.033624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 384/773] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:47.038809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:47.052294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c35f1d-559e-412a-90f2-b8df86042082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:47.052900 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c35f1d-559e-412a-90f2-b8df86042082 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:47.053183 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c35f1d-559e-412a-90f2-b8df86042082 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:47.053492 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c35f1d-559e-412a-90f2-b8df86042082 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:47.054098 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c35f1d-559e-412a-90f2-b8df86042082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:47.055475 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c35f1d-559e-412a-90f2-b8df86042082 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:47.061974 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 390/774] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Aug 19 17:49:46 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 17:49:47.145051 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decf95c-bc74-44fd-adb9-5a3e1289690f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:47.181107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:47.181759 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:47.182044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:47.182320 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:47.182962 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:47.183267 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:47.184655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:47.194648 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 385/775] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:47.195921 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c35f1d-559e-412a-90f2-b8df86042082 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:47.248999 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:47.299002 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c35f1d-559e-412a-90f2-b8df86042082 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:47.332010 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:47.332614 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:47.332891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:47.333162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:47.333817 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:47.334120 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:47.335481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:47.340781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 391/776] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:47.346957 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:47.369292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:47.445948 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaa41c-ebc9-4491-9eca-d710fe00b025 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:47.479424 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7a13c-a926-4f8c-933b-4dc9c87220d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:47.480025 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7a13c-a926-4f8c-933b-4dc9c87220d1 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:47.480303 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7a13c-a926-4f8c-933b-4dc9c87220d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:47.480572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7a13c-a926-4f8c-933b-4dc9c87220d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:47.481261 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7a13c-a926-4f8c-933b-4dc9c87220d1 None admin] RBAC: Adding query filter params (interface=public, service_id=4770390927234fb380bbdf18f727f8a7, region_id=RegionOne) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:47.481598 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7a13c-a926-4f8c-933b-4dc9c87220d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:47.487622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7a13c-a926-4f8c-933b-4dc9c87220d1 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:47.489631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 386/777] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Aug 19 17:49:47 2022] GET /identity/v3/endpoints?service_id=4770390927234fb380bbdf18f727f8a7&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:47.495264 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:47.594815 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1274b1c-e5e3-4d49-b46d-8feb59571056 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:47.608217 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:47.627442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ef90a-f780-4c95-b5d0-4470511d02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:47.628040 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef90a-f780-4c95-b5d0-4470511d02ea None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:47.628316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef90a-f780-4c95-b5d0-4470511d02ea None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:47.628588 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef90a-f780-4c95-b5d0-4470511d02ea None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:47.629183 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ef90a-f780-4c95-b5d0-4470511d02ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:47.630616 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ef90a-f780-4c95-b5d0-4470511d02ea None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:47.636737 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 392/778] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Aug 19 17:49:47 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 17:49:49.271240 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f50ac4-6c88-4557-b5ad-2f55913df4bf None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:49.271804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f50ac4-6c88-4557-b5ad-2f55913df4bf None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:49.271804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f50ac4-6c88-4557-b5ad-2f55913df4bf None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:49.273113 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 387/779] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:49.278479 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f92e-3fd5-4d96-ab65-c70a8718fc44 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:49.278873 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f92e-3fd5-4d96-ab65-c70a8718fc44 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:49.279030 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0f92e-3fd5-4d96-ab65-c70a8718fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:49.297544 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-4ac0f92e-3fd5-4d96-ab65-c70a8718fc44 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:49.298722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-4ac0f92e-3fd5-4d96-ab65-c70a8718fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:49.366645 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 393/780] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:49 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:49.700372 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f50ac4-6c88-4557-b5ad-2f55913df4bf None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:49.783849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:49.799850 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f50ac4-6c88-4557-b5ad-2f55913df4bf None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:49.819604 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77eaa-74ce-4186-8256-0a0b0002c22b None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:49.819926 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77eaa-74ce-4186-8256-0a0b0002c22b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:49.820197 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e77eaa-74ce-4186-8256-0a0b0002c22b None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:49.822061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 394/781] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:49:49.827169 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016dba-5b4f-4ba5-8ce4-b197a4fa054a None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:49.827448 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016dba-5b4f-4ba5-8ce4-b197a4fa054a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:49.827722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd016dba-5b4f-4ba5-8ce4-b197a4fa054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:49.836184 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:49.837409 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:49.837890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:49.838164 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:49.838748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:49.840122 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:49.845668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-cd016dba-5b4f-4ba5-8ce4-b197a4fa054a None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:49.846877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-cd016dba-5b4f-4ba5-8ce4-b197a4fa054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:49.848729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:49.849742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:49.850652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 388/782] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Aug 19 17:49:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:49.855755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:49.914664 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 395/783] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:49 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:49:49.954989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d9a0e-d2d4-444e-b38d-27471e8d354f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:49.987610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:49.988209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:49.988485 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:49.988755 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:49.989374 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:49.989704 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:49.991063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:49.995707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 389/784] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Aug 19 17:49:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:50.001629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016dba-5b4f-4ba5-8ce4-b197a4fa054a None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:50.040986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:50.099109 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd016dba-5b4f-4ba5-8ce4-b197a4fa054a None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:50.131701 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:50.132295 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:50.132574 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:50.132844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:50.133493 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:50.134336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:50.135694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:50.140300 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 396/785] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Aug 19 17:49:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:50.146286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:50.161218 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:50.237983 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:50.245640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb903b18-c85c-4363-a8a2-75eb0ab834a8 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:50.278630 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8e8b-05b7-4945-b4c1-47f997457704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:50.279268 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8e8b-05b7-4945-b4c1-47f997457704 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:50.279495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8e8b-05b7-4945-b4c1-47f997457704 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:50.279766 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f8e8b-05b7-4945-b4c1-47f997457704 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:50.280416 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8e8b-05b7-4945-b4c1-47f997457704 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:50.281799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6f8e8b-05b7-4945-b4c1-47f997457704 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:50.337026 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f7e3b-1c2d-45c3-8332-774d5817b8e3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:50.338551 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:50.352511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 390/786] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 17:49:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:50.379583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:50.380241 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:50.380522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:50.380839 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:50.381522 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:50.382989 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:50.393305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:50.394639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 19 17:49:50.395646 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:50.397599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 397/787] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:50.400686 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8e8b-05b7-4945-b4c1-47f997457704 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:50.471630 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:50.518286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6f8e8b-05b7-4945-b4c1-47f997457704 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:50.548926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:50.549637 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:50.549919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:50.550190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:50.550819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:50.551123 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:50.552508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:50.557952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 391/788] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:50.564030 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:50.663801 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb588-5f98-4714-a2ee-c7b72fd35754 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:50.698093 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64344d-24f9-4ca9-a7ba-5ffd3e708f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:50.698691 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64344d-24f9-4ca9-a7ba-5ffd3e708f36 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:50.698969 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64344d-24f9-4ca9-a7ba-5ffd3e708f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:50.699239 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64344d-24f9-4ca9-a7ba-5ffd3e708f36 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:50.699859 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64344d-24f9-4ca9-a7ba-5ffd3e708f36 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:50.700158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64344d-24f9-4ca9-a7ba-5ffd3e708f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:50.701677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64344d-24f9-4ca9-a7ba-5ffd3e708f36 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:50.706555 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 398/789] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Aug 19 17:49:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:50.712706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:50.811400 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228eec2c-b5fa-4e6b-ae41-87d1723bd447 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:50.840488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:50.845348 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df56447-952e-4b2a-b089-1d27bf18087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:50.845984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56447-952e-4b2a-b089-1d27bf18087d None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:50.846263 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56447-952e-4b2a-b089-1d27bf18087d None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:50.846537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df56447-952e-4b2a-b089-1d27bf18087d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:50.847221 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56447-952e-4b2a-b089-1d27bf18087d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:50.848579 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df56447-952e-4b2a-b089-1d27bf18087d None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:50.955539 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 392/790] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 17:49:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 17:49:52.588704 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ff8e4-f9c3-4e29-8976-2fcb9fd551d3 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:52.589227 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ff8e4-f9c3-4e29-8976-2fcb9fd551d3 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:52.589227 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ff8e4-f9c3-4e29-8976-2fcb9fd551d3 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:52.590605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 399/791] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:49:52.595830 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c2c65-3d66-49eb-a280-01f8daa7c02c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:52.596250 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c2c65-3d66-49eb-a280-01f8daa7c02c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:52.596374 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c2c65-3d66-49eb-a280-01f8daa7c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:52.614495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-746c2c65-3d66-49eb-a280-01f8daa7c02c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:52.615651 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-746c2c65-3d66-49eb-a280-01f8daa7c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:52.688596 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 393/792] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:52 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:53.015917 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ff8e4-f9c3-4e29-8976-2fcb9fd551d3 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:53.045287 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:53.119621 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ff8e4-f9c3-4e29-8976-2fcb9fd551d3 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:53.138016 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025fb0-6c9b-403b-ac98-d6cb16c527ed None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:53.138377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025fb0-6c9b-403b-ac98-d6cb16c527ed None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:53.138715 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea025fb0-6c9b-403b-ac98-d6cb16c527ed None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:53.140104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 394/793] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:49:53.144982 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda52d6-18a7-4ea5-a895-0b35b06429e8 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:53.145266 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda52d6-18a7-4ea5-a895-0b35b06429e8 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:53.145567 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda52d6-18a7-4ea5-a895-0b35b06429e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:53.153465 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:53.154090 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:53.154364 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:53.154632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] PATH_INFO: `/v3/services/compute` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:53.155200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:53.156551 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:53.163829 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-9bda52d6-18a7-4ea5-a895-0b35b06429e8 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:53.164999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-9bda52d6-18a7-4ea5-a895-0b35b06429e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:53.166297 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:53.167269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.168594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 400/794] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:53.173158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:53.233706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 395/795] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:53 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:49:53.265128 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:53.274939 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e172d-875f-48b7-acbc-b62ea0a8517d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:53.309008 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:53.309630 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:53.309908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:53.310178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:53.310791 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] RBAC: Adding query filter params (name=compute) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:53.311093 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:53.312491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:53.316967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 401/796] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:53.322994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda52d6-18a7-4ea5-a895-0b35b06429e8 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:53.370559 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:53.423464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda52d6-18a7-4ea5-a895-0b35b06429e8 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:53.456817 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:53.457407 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:53.457710 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:53.457977 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:53.458595 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] RBAC: Adding query filter params (type=compute) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:53.458891 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:53.460269 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:53.465383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 396/797] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:53.561971 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:53.666958 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0eb07e-6663-40d0-8df3-7ab8706642eb None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:53.700119 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:53.700723 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:53.701003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:53.701273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:53.701953 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:53.703392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:53.705992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING keystone.server.flask.common [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 19 17:49:53.752860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.sql.core [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 17:49:53.752860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 17:49:53.752860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [parameters: {'id': '84edf99f47564302a00cc9608de6ed9a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 17:49:53.752860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88352) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84edf99f47564302a00cc9608de6ed9a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84edf99f47564302a00cc9608de6ed9a. Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application conn.query(q) Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 17:49:53.770001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result.read() Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 19 17:49:53.771061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application next(self.gen) Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application yield resource Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application next(self.gen) Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise self.value Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application session.commit() Aug 19 17:49:53.772742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.session.flush() Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application compat.raise_( Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 17:49:53.775274 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 17:49:53.776844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application conn.query(q) Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result.read() Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 17:49:53.778623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [parameters: {'id': '84edf99f47564302a00cc9608de6ed9a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:53.779927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:53.781904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 84edf99f47564302a00cc9608de6ed9a. Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:53.783985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 402/798] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Aug 19 17:49:53 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:53.785110 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:53.877201 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f9bec-1497-41f0-b864-8ed8ebfe415b None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:53.886893 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:53.910549 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5e0f8-5ade-416c-bb84-1658aaf92ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:53.911174 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e0f8-5ade-416c-bb84-1658aaf92ed8 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:53.911447 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e0f8-5ade-416c-bb84-1658aaf92ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:53.912015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e0f8-5ade-416c-bb84-1658aaf92ed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:53.918516 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5e0f8-5ade-416c-bb84-1658aaf92ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:53.919928 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5e0f8-5ade-416c-bb84-1658aaf92ed8 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-afe5e0f8-5ade-416c-bb84-1658aaf92ed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:49:53.931942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:53.935488 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:53.936467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 397/799] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:53.939267 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:53.953635 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:54.038834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5a192-74c3-469d-a038-6ac2ca14eb77 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:54.071300 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3137b-a736-47ec-9fd9-eb5dfcc8910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:54.072392 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3137b-a736-47ec-9fd9-eb5dfcc8910d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:54.072669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3137b-a736-47ec-9fd9-eb5dfcc8910d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:54.072938 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3137b-a736-47ec-9fd9-eb5dfcc8910d None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:54.073620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3137b-a736-47ec-9fd9-eb5dfcc8910d None admin] RBAC: Adding query filter params (name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:54.073922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3137b-a736-47ec-9fd9-eb5dfcc8910d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:54.075528 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3137b-a736-47ec-9fd9-eb5dfcc8910d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:54.094817 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 403/800] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:49:55.657730 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e1b2-dcce-4aa0-b0e0-10cf3c006d5d None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:55.658260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e1b2-dcce-4aa0-b0e0-10cf3c006d5d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:55.658260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e1b2-dcce-4aa0-b0e0-10cf3c006d5d None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:55.659581 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 398/801] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:55.665031 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335794-d022-45f3-962c-bacd88c9b165 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:55.665537 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335794-d022-45f3-962c-bacd88c9b165 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:55.665827 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8335794-d022-45f3-962c-bacd88c9b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:55.685116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-f8335794-d022-45f3-962c-bacd88c9b165 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:55.686648 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-f8335794-d022-45f3-962c-bacd88c9b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:55.751373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:55.756084 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 404/802] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:55 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:56.086477 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072e1b2-dcce-4aa0-b0e0-10cf3c006d5d None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:56.192496 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072e1b2-dcce-4aa0-b0e0-10cf3c006d5d None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:56.225537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b182a4-1e5a-4bca-982b-f2a2490dd150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:56.226142 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b182a4-1e5a-4bca-982b-f2a2490dd150 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:56.226422 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b182a4-1e5a-4bca-982b-f2a2490dd150 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:56.226694 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b182a4-1e5a-4bca-982b-f2a2490dd150 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:56.227340 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b182a4-1e5a-4bca-982b-f2a2490dd150 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:56.229447 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b182a4-1e5a-4bca-982b-f2a2490dd150 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:56.297080 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 399/803] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:49:56 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:49:56.317759 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140f0f-7292-49a7-ac4b-f022cdf8b9f1 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:56.318044 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140f0f-7292-49a7-ac4b-f022cdf8b9f1 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:56.318318 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37140f0f-7292-49a7-ac4b-f022cdf8b9f1 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:56.319693 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 405/804] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:49:56.326003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60705-f525-4bb6-b9c3-caac84abadfa None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:56.326297 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60705-f525-4bb6-b9c3-caac84abadfa None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:56.331191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc60705-f525-4bb6-b9c3-caac84abadfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:56.346333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-abc60705-f525-4bb6-b9c3-caac84abadfa None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:56.347466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-abc60705-f525-4bb6-b9c3-caac84abadfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:56.373117 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:56.426593 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 400/805] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:56 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:56.754886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140f0f-7292-49a7-ac4b-f022cdf8b9f1 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:56.855767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37140f0f-7292-49a7-ac4b-f022cdf8b9f1 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:56.888885 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:56.889496 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:56.889777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:56.890049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:56.890682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:56.892110 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:56.947230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.sql.core [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 17:49:56.947230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 17:49:56.947230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [parameters: {'user_id': 'ddcc1cde2e2c4b3c9694671042f060d5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 17:49:56.947230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88352) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application conn.query(q) Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result.read() Aug 19 17:49:56.953629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 17:49:56.954684 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application next(self.gen) Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application yield resource Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application next(self.gen) Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.session.rollback() Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.force_reraise() Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise self.value Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application session.commit() Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 19 17:49:56.955696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._prepare_impl() Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.session.flush() Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._flush(objects) Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application compat.raise_( Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application flush_context.execute() Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rec.execute(self) Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 19 17:49:56.956609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 19 17:49:56.957536 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result = self._query(query) Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application conn.query(q) Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application result.read() Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 19 17:49:56.958409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ddcc1cde2e2c4b3c9694671042f060d5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:56.959262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 19 17:49:56.960069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 19 17:49:56.961043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 19 17:49:56.961043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 19 17:49:56.961043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 19 17:49:56.961043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 19 17:49:56.961043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 19 17:49:56.961043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:49:56.961043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 406/806] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Aug 19 17:49:56 2022] POST /identity/v3/users => generated 160 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:56.963451 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc60705-f525-4bb6-b9c3-caac84abadfa None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:57.059348 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc60705-f525-4bb6-b9c3-caac84abadfa None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:57.091764 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950bd8e-3db5-4d2a-a3dc-f68a1ca9b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:57.092390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bd8e-3db5-4d2a-a3dc-f68a1ca9b764 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:57.092665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bd8e-3db5-4d2a-a3dc-f68a1ca9b764 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:57.092933 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950bd8e-3db5-4d2a-a3dc-f68a1ca9b764 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:57.099593 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950bd8e-3db5-4d2a-a3dc-f68a1ca9b764 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:57.101026 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950bd8e-3db5-4d2a-a3dc-f68a1ca9b764 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-4950bd8e-3db5-4d2a-a3dc-f68a1ca9b764 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:49:57.112645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:57.113931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:57.114968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 401/807] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:49:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:49:57.119965 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:57.182690 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:57.222125 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3ba31-358a-485c-8260-58a093ffc985 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:57.256045 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7b204-c2c5-4eba-813b-4cabaa47ae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:57.256644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7b204-c2c5-4eba-813b-4cabaa47ae18 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:57.256921 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7b204-c2c5-4eba-813b-4cabaa47ae18 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:57.257192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7b204-c2c5-4eba-813b-4cabaa47ae18 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:57.257914 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7b204-c2c5-4eba-813b-4cabaa47ae18 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:57.258221 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7b204-c2c5-4eba-813b-4cabaa47ae18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:57.260366 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7b204-c2c5-4eba-813b-4cabaa47ae18 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:57.299201 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 407/808] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Aug 19 17:49:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:58.519504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e76b2-3385-46e8-8a99-7fb039e97cc5 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:58.519985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e76b2-3385-46e8-8a99-7fb039e97cc5 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:58.520089 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e76b2-3385-46e8-8a99-7fb039e97cc5 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:58.521355 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 402/809] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 17:49:58.526560 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807ef5-afe7-42a4-b25d-95bf60b9e84d None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:58.526936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807ef5-afe7-42a4-b25d-95bf60b9e84d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:58.527120 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807ef5-afe7-42a4-b25d-95bf60b9e84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:58.545673 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-bd807ef5-afe7-42a4-b25d-95bf60b9e84d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:49:58.547177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-bd807ef5-afe7-42a4-b25d-95bf60b9e84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:49:58.612304 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 408/810] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:49:58 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:49:58.941945 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e76b2-3385-46e8-8a99-7fb039e97cc5 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:58.959370 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:59.042997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e76b2-3385-46e8-8a99-7fb039e97cc5 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:59.074719 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:59.075320 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:59.075594 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:59.075860 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:59.076427 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:59.077800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:49:59.086276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:49:59.087992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:49:59.088969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 403/811] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:49:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:49:59.094015 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807ef5-afe7-42a4-b25d-95bf60b9e84d None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:59.142384 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:59.190641 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807ef5-afe7-42a4-b25d-95bf60b9e84d None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:59.223075 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:59.223611 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:59.223890 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:59.224160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:59.224775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:59.225079 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:59.226474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:59.231412 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 409/812] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:59.237075 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:59.329793 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:59.349867 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c398a8-5287-473e-824f-15a7d94ea7b8 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:59.382480 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:59.383150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:59.383424 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:59.383692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:59.384916 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:59.385213 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:59.386594 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:59.391234 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 404/813] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:49:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:59.397330 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:59.502356 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a090cc-0643-4b90-ae53-730ec8323d53 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:59.515790 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:49:59.535090 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719904-819b-4195-a73e-780f1032435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:59.538147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719904-819b-4195-a73e-780f1032435d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:59.538147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719904-819b-4195-a73e-780f1032435d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:59.538147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719904-819b-4195-a73e-780f1032435d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:59.538147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d719904-819b-4195-a73e-780f1032435d None admin] RBAC: Adding query filter params (interface=public, service_id=da30f1759abc4ea9a13438e2a4d60127, region_id=RegionOne) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:49:59.538147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d719904-819b-4195-a73e-780f1032435d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:59.538920 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d719904-819b-4195-a73e-780f1032435d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:59.544387 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 410/814] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Aug 19 17:49:59 2022] GET /identity/v3/endpoints?service_id=da30f1759abc4ea9a13438e2a4d60127&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:49:59.550154 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:49:59.648446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6ab72-9217-46e7-8b49-e081c64d4103 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:49:59.682788 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbe086-0d5a-4caf-9197-daca385007a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:49:59.683386 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbe086-0d5a-4caf-9197-daca385007a0 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:49:59.683671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbe086-0d5a-4caf-9197-daca385007a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:49:59.683927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbe086-0d5a-4caf-9197-daca385007a0 None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:49:59.684519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbe086-0d5a-4caf-9197-daca385007a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:49:59.685900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbe086-0d5a-4caf-9197-daca385007a0 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:49:59.691790 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 405/815] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Aug 19 17:49:59 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:50:01.860102 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdcd17-5983-46d5-af70-9b07e03c1683 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:01.860607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdcd17-5983-46d5-af70-9b07e03c1683 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:01.860607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdcd17-5983-46d5-af70-9b07e03c1683 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:01.862789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 411/816] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:50:01.867593 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a63704-355c-47fd-a32b-20963efa0bd4 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:01.868043 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a63704-355c-47fd-a32b-20963efa0bd4 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:01.868152 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a63704-355c-47fd-a32b-20963efa0bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:01.881375 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:50:01.887492 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-35a63704-355c-47fd-a32b-20963efa0bd4 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:50:01.888664 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-35a63704-355c-47fd-a32b-20963efa0bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:50:01.953787 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 406/817] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:50:01 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:50:02.285707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdcd17-5983-46d5-af70-9b07e03c1683 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:02.387357 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdcd17-5983-46d5-af70-9b07e03c1683 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:02.423371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:02.424001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:02.424306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:02.424579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:02.425153 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:02.426553 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:50:02.435194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:50:02.436378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:50:02.437450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 412/818] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:50:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:50:02.442301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a63704-355c-47fd-a32b-20963efa0bd4 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:02.560400 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a63704-355c-47fd-a32b-20963efa0bd4 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:02.595735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:02.596331 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:02.596600 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:02.596873 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:02.597532 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] RBAC: Adding query filter params (name=compute) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:50:02.597834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:02.599194 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:02.600968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:50:02.604665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 407/819] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:50:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:50:02.610474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:02.658350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:50:02.716887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d674948-ab22-4a18-a91f-830603bcc2d4 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:02.751087 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06daa0d5-a0fa-4648-a73c-7a208f594956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:02.751690 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa0d5-a0fa-4648-a73c-7a208f594956 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:02.751967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa0d5-a0fa-4648-a73c-7a208f594956 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:02.752239 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06daa0d5-a0fa-4648-a73c-7a208f594956 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:02.752855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daa0d5-a0fa-4648-a73c-7a208f594956 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:50:02.753155 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daa0d5-a0fa-4648-a73c-7a208f594956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:02.754671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06daa0d5-a0fa-4648-a73c-7a208f594956 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:02.759839 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 413/820] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Aug 19 17:50:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:50:02.765827 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:50:02.888408 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd5e0ef-9b7f-4722-9a97-11572529afcd None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:50:02.925363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac976d4-8e5c-4e05-8167-a58873e83eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:50:02.925994 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac976d4-8e5c-4e05-8167-a58873e83eba None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:50:02.926270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac976d4-8e5c-4e05-8167-a58873e83eba None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:50:02.926537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac976d4-8e5c-4e05-8167-a58873e83eba None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:50:02.927206 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac976d4-8e5c-4e05-8167-a58873e83eba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:50:02.928692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac976d4-8e5c-4e05-8167-a58873e83eba None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:50:03.011815 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 408/821] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 17:50:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:50:12.756956 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=47 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:50:13.006349 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:22.293268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f02c3-45ea-4f98-908d-1928c2108d00 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:22.293895 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f02c3-45ea-4f98-908d-1928c2108d00 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:22.293895 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f02c3-45ea-4f98-908d-1928c2108d00 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:22.295156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 414/822] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:22.301030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3782a84-0914-4adc-99da-f2e992741547 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:22.301836 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3782a84-0914-4adc-99da-f2e992741547 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:22.301836 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3782a84-0914-4adc-99da-f2e992741547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:22.319377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-c3782a84-0914-4adc-99da-f2e992741547 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:22.320551 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-c3782a84-0914-4adc-99da-f2e992741547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:22.391380 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 409/823] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:22.730396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f02c3-45ea-4f98-908d-1928c2108d00 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:22.830628 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f02c3-45ea-4f98-908d-1928c2108d00 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:22.866556 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:22.867175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:22.867450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:22.867720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:22.878233 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:22.879661 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:22.893835 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:22.895569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:22.896638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:22.896638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:22.896638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:22.896638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 415/824] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:51:22.901179 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3782a84-0914-4adc-99da-f2e992741547 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:23.002441 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3782a84-0914-4adc-99da-f2e992741547 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:23.027753 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:23.036909 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680006e5-a774-4699-80a6-662d2a9f986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:23.037605 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680006e5-a774-4699-80a6-662d2a9f986e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:23.037890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680006e5-a774-4699-80a6-662d2a9f986e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:23.038164 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680006e5-a774-4699-80a6-662d2a9f986e None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:23.039057 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680006e5-a774-4699-80a6-662d2a9f986e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:23.039361 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680006e5-a774-4699-80a6-662d2a9f986e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:23.040721 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680006e5-a774-4699-80a6-662d2a9f986e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:23.052222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 410/825] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:23.058251 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:23.110411 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:23.157154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7dcf-2c86-4a70-89dc-b1bf872fbe88 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:23.192168 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e25e9-ce1f-4283-9e84-bb5360762f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:23.192771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e25e9-ce1f-4283-9e84-bb5360762f33 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:23.193053 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e25e9-ce1f-4283-9e84-bb5360762f33 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:23.193327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e25e9-ce1f-4283-9e84-bb5360762f33 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:23.194020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e25e9-ce1f-4283-9e84-bb5360762f33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:23.195457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e25e9-ce1f-4283-9e84-bb5360762f33 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:23.315391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 416/826] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Aug 19 17:51:23 2022] POST /identity/v3/users => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:51:25.541225 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3be8-bd8e-4799-a43d-7dc86dc7e951 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:25.541765 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3be8-bd8e-4799-a43d-7dc86dc7e951 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:25.541922 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3be8-bd8e-4799-a43d-7dc86dc7e951 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:25.543286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 411/827] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:25.549247 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8b13-7bf9-4528-8626-5c4ea47606ac None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:25.559373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8b13-7bf9-4528-8626-5c4ea47606ac None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:25.559373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b8b13-7bf9-4528-8626-5c4ea47606ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:25.568917 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-2c9b8b13-7bf9-4528-8626-5c4ea47606ac None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:25.570142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-2c9b8b13-7bf9-4528-8626-5c4ea47606ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:25.635988 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 417/828] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:25 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:25.967458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa3be8-bd8e-4799-a43d-7dc86dc7e951 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:26.067552 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa3be8-bd8e-4799-a43d-7dc86dc7e951 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:26.100802 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951640e2-cf7c-42ce-b02c-db025f5cdc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:26.101445 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951640e2-cf7c-42ce-b02c-db025f5cdc5b None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:26.101798 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951640e2-cf7c-42ce-b02c-db025f5cdc5b None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:26.102071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951640e2-cf7c-42ce-b02c-db025f5cdc5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:26.114520 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951640e2-cf7c-42ce-b02c-db025f5cdc5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-951640e2-cf7c-42ce-b02c-db025f5cdc5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:51:26.119171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:26.120238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:26.121127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 412/829] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:51:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:26.126474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b8b13-7bf9-4528-8626-5c4ea47606ac None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:26.165767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:26.223292 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b8b13-7bf9-4528-8626-5c4ea47606ac None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:26.257159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:26.257783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:26.258064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:26.258337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:26.259000 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] RBAC: Adding query filter params (name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:26.259303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:26.260674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:26.268955 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 418/830] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:26.274824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951640e2-cf7c-42ce-b02c-db025f5cdc5b None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:26.323092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:26.375434 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951640e2-cf7c-42ce-b02c-db025f5cdc5b None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:26.408424 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:26.409043 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:26.409323 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:26.409626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:26.420209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:26.429160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:26.436128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:26.437112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:26.438384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:26.438384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:26.438384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:26.438384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 413/831] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:26.443635 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:26.542862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:26.545600 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5ddac-c139-4128-bec4-b4a7abe98d35 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:26.578637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:26.579267 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:26.579535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:26.579804 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:26.580432 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:26.580735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:26.582191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:26.593620 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 419/832] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:26.599499 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:26.696995 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:26.700862 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712e3e-4eeb-46fe-af63-d5ae86f46d32 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:26.733583 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:26.734198 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:26.734472 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:26.734738 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:26.743058 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:26.744427 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:51:26.755713 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:26.759536 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:26.760495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 414/833] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:26.762732 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:26.859656 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04216a9-d3b2-4e99-869f-d3fb3de142ba None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:26.893461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:26.894060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:26.894336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:26.894602 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:26.895312 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:26.895612 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:26.897036 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:26.914140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 420/834] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Aug 19 17:51:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:26.920020 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:27.021196 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72f61d-284d-46de-9d1a-74e7229f0fe7 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:27.054405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7418723-e0c7-4a0a-9f86-8fec3e6e787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:27.055005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418723-e0c7-4a0a-9f86-8fec3e6e787e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:27.055285 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418723-e0c7-4a0a-9f86-8fec3e6e787e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:27.055557 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418723-e0c7-4a0a-9f86-8fec3e6e787e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:27.081965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:27.121188 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7418723-e0c7-4a0a-9f86-8fec3e6e787e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:27.122675 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7418723-e0c7-4a0a-9f86-8fec3e6e787e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:27.221950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 415/835] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:51:26 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:51:27.227887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:27.246405 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:27.332059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a1120-5749-4d00-81fe-265552bea498 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:27.367690 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:27.368311 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:27.368586 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:27.368861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:27.379840 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:27.384978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:27.397400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:27.399975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:27.400930 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:27.400930 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:27.400930 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:27.400930 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 421/836] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:27.404365 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7418723-e0c7-4a0a-9f86-8fec3e6e787e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:27.465382 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:27.508731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7418723-e0c7-4a0a-9f86-8fec3e6e787e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:27.543832 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:27.544444 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:27.544725 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:27.544997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:27.545774 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:27.546079 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:27.547436 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:27.558347 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 416/837] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:51:27.564508 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:27.634161 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:27.664852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d270f80-3eb1-4314-a7e3-341221e51835 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:27.697161 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:27.698117 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:27.698568 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:27.699267 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:27.706687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:27.708184 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:51:27.719403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:27.720515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:27.721494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 422/838] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:27.726720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:27.829843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee52f82-7856-4402-bfc4-f8d6f734e003 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:27.847051 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:27.864063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77b721-cacf-439c-8430-7a5f5c6679e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:27.864665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b721-cacf-439c-8430-7a5f5c6679e7 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:27.864945 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b721-cacf-439c-8430-7a5f5c6679e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:27.865217 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b721-cacf-439c-8430-7a5f5c6679e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:27.865936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77b721-cacf-439c-8430-7a5f5c6679e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:27.869059 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77b721-cacf-439c-8430-7a5f5c6679e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:27.869059 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77b721-cacf-439c-8430-7a5f5c6679e7 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:27.880081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 417/839] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:27.886472 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:27.987722 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829d542-9596-4eb8-8fdd-f6963d976045 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:28.016043 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:28.022597 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432f166-e4c8-4622-b020-4a632d973002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:28.023204 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f166-e4c8-4622-b020-4a632d973002 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:28.023482 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f166-e4c8-4622-b020-4a632d973002 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:28.023754 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f166-e4c8-4622-b020-4a632d973002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:28.024468 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432f166-e4c8-4622-b020-4a632d973002 None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=1b03819209cf40619ba66506a8205b68) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:28.024778 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432f166-e4c8-4622-b020-4a632d973002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:28.026293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432f166-e4c8-4622-b020-4a632d973002 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:28.031487 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 423/840] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:51:27 2022] GET /identity/v3/role_assignments?user.id=1b03819209cf40619ba66506a8205b68&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:30.243566 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176435-e041-4411-8c65-9ab8b2cffb2e None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:30.244122 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176435-e041-4411-8c65-9ab8b2cffb2e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:30.244122 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6176435-e041-4411-8c65-9ab8b2cffb2e None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:30.245477 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 418/841] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:30.250683 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e17e-1312-44ec-a3fd-092d9d02ec50 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:30.252538 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e17e-1312-44ec-a3fd-092d9d02ec50 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:30.252538 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51e17e-1312-44ec-a3fd-092d9d02ec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:30.269789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-2e51e17e-1312-44ec-a3fd-092d9d02ec50 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:30.270986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-2e51e17e-1312-44ec-a3fd-092d9d02ec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:30.338554 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 424/842] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:30 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:30.663112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6176435-e041-4411-8c65-9ab8b2cffb2e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:30.765442 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6176435-e041-4411-8c65-9ab8b2cffb2e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:30.798895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3cd3-ad43-4fb3-b53d-089f19f08b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:30.799516 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3cd3-ad43-4fb3-b53d-089f19f08b36 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:30.799791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3cd3-ad43-4fb3-b53d-089f19f08b36 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:30.800072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3cd3-ad43-4fb3-b53d-089f19f08b36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:30.813919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b3cd3-ad43-4fb3-b53d-089f19f08b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-197b3cd3-ad43-4fb3-b53d-089f19f08b36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:51:30.818556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:30.819689 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:30.820898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 419/843] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:51:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:51:30.825579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51e17e-1312-44ec-a3fd-092d9d02ec50 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:30.922445 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51e17e-1312-44ec-a3fd-092d9d02ec50 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:30.945901 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:30.956757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:30.957365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:30.957662 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:30.958023 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:30.958575 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] RBAC: Adding query filter params (name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:30.958878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:30.960226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:30.967780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 425/844] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:30.974389 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3cd3-ad43-4fb3-b53d-089f19f08b36 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:31.013207 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:31.072512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3cd3-ad43-4fb3-b53d-089f19f08b36 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:31.107016 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:31.107641 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:31.110030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:31.110030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:31.118356 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:31.119804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:31.133826 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:31.135017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:31.136150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:31.136150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:31.136150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:31.136150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 420/845] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:31.140880 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:31.240978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b2cf1-c0b1-4dd7-9667-10f21caf9c1d None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:31.275133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:31.275800 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:31.276009 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:31.276340 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:31.276976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:31.277284 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:31.278688 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:31.291740 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 426/846] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:31.297564 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:31.388359 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:31.398447 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40971edc-3d8c-4149-a0af-271fb3a5027e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:31.431014 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:31.431637 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:31.431969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:31.432240 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:31.440100 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:31.441575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:51:31.452610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:31.453816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:31.455572 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 421/847] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:31.460105 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:31.509092 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:31.561485 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ab28-752b-456c-9978-004a2cb64ccc None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:31.595661 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:31.596306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:31.596584 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:31.596882 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:31.599686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:31.603876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:31.603876 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:31.619083 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 427/848] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Aug 19 17:51:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:31.624951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:31.723936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e2084-48b4-4959-8314-5a6c90a103f0 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:31.757160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:31.757812 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:31.758092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:31.758365 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:31.769126 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:31.770541 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:31.784620 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:31.785750 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:31.786693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:31.786693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:31.786693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:31.786693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 422/849] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:31.791981 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:31.890336 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fde0ac-e921-4c2c-96b3-c065d7033951 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:31.892792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:31.926628 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:31.927226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:31.927505 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:31.927778 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:31.928407 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:31.928708 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:31.930100 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:31.947636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 428/850] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:31.953362 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:31.956504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:32.053467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ffdd-18ee-4ace-a483-d04407169b18 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:32.086151 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:32.086771 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:32.087092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:32.087388 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:32.093875 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:32.095925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:51:32.106791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:32.107741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:32.108669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 423/851] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:32.114558 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:32.215685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab4e86-58ce-4351-b587-1c7d940bb6ce None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:32.249410 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b546ce-461c-49c1-8a44-c0da8cdb0245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:32.250038 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b546ce-461c-49c1-8a44-c0da8cdb0245 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:32.250316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b546ce-461c-49c1-8a44-c0da8cdb0245 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:32.250687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b546ce-461c-49c1-8a44-c0da8cdb0245 None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:32.255509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b546ce-461c-49c1-8a44-c0da8cdb0245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:32.255822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b546ce-461c-49c1-8a44-c0da8cdb0245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:32.257286 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b546ce-461c-49c1-8a44-c0da8cdb0245 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:32.272290 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 429/852] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:32.278384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:32.340558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:32.378419 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94275a97-f23a-42c7-92d0-da006ca2c903 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:32.411785 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cee59-4e0d-45e3-ba8a-119ac449099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:32.412473 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee59-4e0d-45e3-ba8a-119ac449099b None admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:32.412751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee59-4e0d-45e3-ba8a-119ac449099b None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:32.413022 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee59-4e0d-45e3-ba8a-119ac449099b None admin] PATH_INFO: `/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/1b03819209cf40619ba66506a8205b68/roles/cc7ad901d358490aad038c78057fce9c` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:32.427586 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cee59-4e0d-45e3-ba8a-119ac449099b None admin] RBAC: Authorizing `identity:create_grant(project_id=0faa0bfd1ad0406eb336f391d6846bbd, user_id=1b03819209cf40619ba66506a8205b68, role_id=cc7ad901d358490aad038c78057fce9c)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:32.429070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cee59-4e0d-45e3-ba8a-119ac449099b None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:32.560727 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 424/853] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:51:32 2022] PUT /identity/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/1b03819209cf40619ba66506a8205b68/roles/cc7ad901d358490aad038c78057fce9c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:51:34.760489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ee62-0ccb-47b7-ab87-167d9fb9610a None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:34.760993 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ee62-0ccb-47b7-ab87-167d9fb9610a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:34.760993 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17ee62-0ccb-47b7-ab87-167d9fb9610a None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:34.762370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 430/854] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:34.767754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdaa54-69b3-4789-8791-99a7d8dc9b07 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:34.768173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdaa54-69b3-4789-8791-99a7d8dc9b07 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:34.768301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdaa54-69b3-4789-8791-99a7d8dc9b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:34.785884 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-aebdaa54-69b3-4789-8791-99a7d8dc9b07 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:34.787047 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-aebdaa54-69b3-4789-8791-99a7d8dc9b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:34.853167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 425/855] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:35.181208 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17ee62-0ccb-47b7-ab87-167d9fb9610a None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:35.206331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:35.281192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17ee62-0ccb-47b7-ab87-167d9fb9610a None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:35.316711 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5058-f415-4739-b440-03c83db08619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:35.317330 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5058-f415-4739-b440-03c83db08619 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:35.317635 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5058-f415-4739-b440-03c83db08619 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:35.317905 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b5058-f415-4739-b440-03c83db08619 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:35.327991 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b5058-f415-4739-b440-03c83db08619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-9a5b5058-f415-4739-b440-03c83db08619 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:51:35.332796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:35.333946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:35.335192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 431/856] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Aug 19 17:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:35.339930 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdaa54-69b3-4789-8791-99a7d8dc9b07 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:35.383027 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:35.439597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdaa54-69b3-4789-8791-99a7d8dc9b07 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:35.472188 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:35.472790 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:35.473073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:35.473348 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:35.474037 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] RBAC: Adding query filter params (name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:35.474344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:35.475702 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:35.483422 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 426/857] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Aug 19 17:51:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:35.490558 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5058-f415-4739-b440-03c83db08619 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:35.579413 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:35.594738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b5058-f415-4739-b440-03c83db08619 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:35.628227 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:35.628886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:35.629142 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:35.629411 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:35.639665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:35.641970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:35.657156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:35.658907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:35.659967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:35.659967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:35.659967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:35.659967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 432/858] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:35.664870 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:35.764785 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ce13-ae7f-4d33-bf0e-5073585a3b47 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:35.767148 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:35.798060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:35.799456 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:35.799736 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:35.800007 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:35.800636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:35.800936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:35.802335 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:35.814448 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 427/859] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:35.820204 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:35.920316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f3a18-2fbd-4ff8-a4a3-52556a010596 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:35.953788 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:35.954438 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:35.954686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:35.954962 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:35.957683 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:35.962499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:35.963935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:51:35.975194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:35.981767 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:35.982753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 433/860] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:35.983399 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:36.082163 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd27eb-df25-4baf-8a99-59aeb43a8854 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:36.115626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:36.116228 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:36.116508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:36.116775 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:36.117514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:36.117814 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:36.119228 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:36.135818 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 428/861] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Aug 19 17:51:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:36.141689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:36.241218 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee0ce-7579-4b22-8b66-27a3689f13e3 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:36.274319 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683163a-b8af-436b-996e-248819f98c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:36.274912 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683163a-b8af-436b-996e-248819f98c4e None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:36.275187 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683163a-b8af-436b-996e-248819f98c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:36.275456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683163a-b8af-436b-996e-248819f98c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:36.335946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:36.342314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683163a-b8af-436b-996e-248819f98c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:36.343846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683163a-b8af-436b-996e-248819f98c4e None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:36.441571 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 434/862] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:51:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:51:36.447454 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:36.471992 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:36.546557 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918c08e-03ae-4456-adc4-e458e8466294 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:36.581851 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:36.582517 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:36.582793 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:36.583063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:36.592868 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:36.594278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:36.608440 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:36.609582 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:36.610756 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:36.610756 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:36.610756 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:36.610756 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 429/863] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:36.615741 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683163a-b8af-436b-996e-248819f98c4e None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:36.711244 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:36.716919 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683163a-b8af-436b-996e-248819f98c4e None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:36.749440 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:36.750035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:36.750310 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:36.750579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:36.751707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:36.752258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:36.753679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:36.764604 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 435/864] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:36.771324 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:36.847197 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:36.871886 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460444ab-fde6-439a-9f68-7c578353cf3f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:36.904818 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:36.905459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:36.905733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:36.906003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:36.913330 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:36.915049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:51:36.926634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:36.927809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:36.929121 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 430/865] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:36.933627 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:37.032884 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef10ab-a2a9-432f-b36b-7d4cf1c6bf01 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:37.066885 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8a9c-bf9b-43d7-9f78-4d6c137c6d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:37.067489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8a9c-bf9b-43d7-9f78-4d6c137c6d6f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:37.067877 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8a9c-bf9b-43d7-9f78-4d6c137c6d6f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:37.068074 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8a9c-bf9b-43d7-9f78-4d6c137c6d6f None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:37.068749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8a9c-bf9b-43d7-9f78-4d6c137c6d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:37.069056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8a9c-bf9b-43d7-9f78-4d6c137c6d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:37.070515 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a8a9c-bf9b-43d7-9f78-4d6c137c6d6f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:37.082457 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 436/866] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:37.088479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:37.187246 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43150def-9d4c-4af4-8f81-d481a3bf1083 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:37.219700 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370b88-fa28-4938-a672-1f65f3bc51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:37.220858 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370b88-fa28-4938-a672-1f65f3bc51d4 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:37.221139 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370b88-fa28-4938-a672-1f65f3bc51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:37.221443 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370b88-fa28-4938-a672-1f65f3bc51d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:37.222166 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370b88-fa28-4938-a672-1f65f3bc51d4 None admin] RBAC: Adding query filter params (role.id=cc7ad901d358490aad038c78057fce9c, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=1b03819209cf40619ba66506a8205b68) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:37.222477 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370b88-fa28-4938-a672-1f65f3bc51d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:37.223903 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370b88-fa28-4938-a672-1f65f3bc51d4 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:37.225655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:37.230173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 431/867] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:51:37 2022] GET /identity/v3/role_assignments?user.id=1b03819209cf40619ba66506a8205b68&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=cc7ad901d358490aad038c78057fce9c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:39.446992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a9386-960b-48d0-bbfc-baf96b4ee3a4 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:39.447540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a9386-960b-48d0-bbfc-baf96b4ee3a4 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:39.447540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a9386-960b-48d0-bbfc-baf96b4ee3a4 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:39.448875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 437/868] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:39.454135 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaffe-7245-443f-abbe-2764ab6378d7 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:39.455181 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaffe-7245-443f-abbe-2764ab6378d7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:39.455389 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aaaffe-7245-443f-abbe-2764ab6378d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:39.473950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-b5aaaffe-7245-443f-abbe-2764ab6378d7 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:39.478184 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-b5aaaffe-7245-443f-abbe-2764ab6378d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:39.541866 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 432/869] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:39 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:39.872670 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a9386-960b-48d0-bbfc-baf96b4ee3a4 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:39.891269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:39.972301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a9386-960b-48d0-bbfc-baf96b4ee3a4 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:40.005994 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d2d6-f4e3-4937-9447-fe5f0b6fd3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:40.006631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d2d6-f4e3-4937-9447-fe5f0b6fd3da None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:40.006908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d2d6-f4e3-4937-9447-fe5f0b6fd3da None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:40.007178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9d2d6-f4e3-4937-9447-fe5f0b6fd3da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:40.017436 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9d2d6-f4e3-4937-9447-fe5f0b6fd3da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-08b9d2d6-f4e3-4937-9447-fe5f0b6fd3da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:51:40.022061 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:40.023170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:40.028749 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 438/870] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:40.029486 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaaffe-7245-443f-abbe-2764ab6378d7 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:40.127571 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aaaffe-7245-443f-abbe-2764ab6378d7 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:40.152913 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:40.161050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:40.161674 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:40.161952 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:40.162221 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:40.162874 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:40.163176 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:40.164804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:40.172522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 433/871] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:40.179343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d2d6-f4e3-4937-9447-fe5f0b6fd3da None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:40.259527 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:40.281636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9d2d6-f4e3-4937-9447-fe5f0b6fd3da None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:40.315540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:40.316165 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:40.316444 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:40.316724 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:40.327205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:40.330885 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:40.342644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:40.343742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:40.345583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:40.345583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:40.345583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:40.345583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 439/872] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:40.350326 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:40.449267 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a72033-5bf9-4a6c-8f92-66628c8af579 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:40.482525 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:40.483144 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:40.483427 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:40.483705 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:40.484503 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:40.484820 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:40.487012 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:40.499116 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 434/873] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:51:40.504828 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:40.604246 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be46f8-0269-44b4-b945-b3d8746569af None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:40.630402 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:40.637984 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:40.638607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:40.638913 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:40.639231 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:40.646594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:40.648085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:51:40.659057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:40.660195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:40.661576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 440/874] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:40.666306 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:40.717658 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:40.766491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec6371-d17d-42b5-8482-70ee3fee5010 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:40.801578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:40.802188 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:40.802467 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:40.802736 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:40.803455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:40.803761 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:40.805247 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:40.822815 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 435/875] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Aug 19 17:51:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:40.828686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:40.930076 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189ca6-4716-4b0c-ac7b-4f954100f960 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:40.963178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a5f23-8291-4b3a-bfbe-fd5e38df9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:40.963777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a5f23-8291-4b3a-bfbe-fd5e38df9ded None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:40.964055 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a5f23-8291-4b3a-bfbe-fd5e38df9ded None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:40.964326 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a5f23-8291-4b3a-bfbe-fd5e38df9ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:41.018348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:41.029914 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a5f23-8291-4b3a-bfbe-fd5e38df9ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:41.031360 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a5f23-8291-4b3a-bfbe-fd5e38df9ded None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:41.129367 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 441/876] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:51:40 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:51:41.135178 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:41.233839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2020912-772e-4006-b405-7afa635484d0 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:41.244193 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:41.268747 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:41.269320 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:41.269628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:41.269901 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:41.279662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:41.283071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:41.296846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:41.298040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:41.299420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:41.299420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:41.299420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:41.299420 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 436/877] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:41.303959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a5f23-8291-4b3a-bfbe-fd5e38df9ded None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:41.389817 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:41.402157 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a5f23-8291-4b3a-bfbe-fd5e38df9ded None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:41.436060 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:41.436691 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:41.436970 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:41.437242 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:41.437968 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:41.438315 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:41.439781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:41.451147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 442/878] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:41.457707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:41.560191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b6f36-e037-4ed4-b489-377da4d5d615 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:41.593018 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:41.593707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:41.593988 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:41.594261 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:41.600808 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:41.602329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:51:41.613961 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:41.617255 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:41.618405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 437/879] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:41.621207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:41.719259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ab591-3a00-4564-8afe-b5654f443c98 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:41.753774 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4cd7d-7ecb-491e-b8d3-116d229ba5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:41.754397 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4cd7d-7ecb-491e-b8d3-116d229ba5de None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:41.754675 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4cd7d-7ecb-491e-b8d3-116d229ba5de None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:41.754947 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4cd7d-7ecb-491e-b8d3-116d229ba5de None admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:41.755623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4cd7d-7ecb-491e-b8d3-116d229ba5de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:41.755927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4cd7d-7ecb-491e-b8d3-116d229ba5de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:41.757456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4cd7d-7ecb-491e-b8d3-116d229ba5de None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:41.769694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 443/880] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:41.776006 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:41.799562 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:41.876429 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0048759-8eac-4af0-87f8-378d59827575 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:41.910049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb022c-bdcc-4479-935f-c64ece73c79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:41.910763 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb022c-bdcc-4479-935f-c64ece73c79e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:41.911087 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb022c-bdcc-4479-935f-c64ece73c79e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:41.911361 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb022c-bdcc-4479-935f-c64ece73c79e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:41.912071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb022c-bdcc-4479-935f-c64ece73c79e None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=1b03819209cf40619ba66506a8205b68) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:41.912377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb022c-bdcc-4479-935f-c64ece73c79e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:41.913819 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb022c-bdcc-4479-935f-c64ece73c79e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:41.919629 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 438/881] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:51:41 2022] GET /identity/v3/role_assignments?user.id=1b03819209cf40619ba66506a8205b68&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=757702b4209942a3b2ec7bf21d995169 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:44.070745 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb566614-ffaf-4342-9d26-27fa888f3c6d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:44.071309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb566614-ffaf-4342-9d26-27fa888f3c6d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:44.071309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb566614-ffaf-4342-9d26-27fa888f3c6d None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:44.072739 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 444/882] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:44.078073 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ee206-6fba-4f2f-aa0e-20024c93e4eb None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:44.078486 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ee206-6fba-4f2f-aa0e-20024c93e4eb None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:44.078595 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ee206-6fba-4f2f-aa0e-20024c93e4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:44.097112 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e67ee206-6fba-4f2f-aa0e-20024c93e4eb None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:44.098311 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e67ee206-6fba-4f2f-aa0e-20024c93e4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:44.164344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 439/883] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:44.494119 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb566614-ffaf-4342-9d26-27fa888f3c6d None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:44.505480 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:44.596246 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb566614-ffaf-4342-9d26-27fa888f3c6d None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:44.630162 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5c9d3-78b3-4791-93d0-fd77bb8baf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:44.630779 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c9d3-78b3-4791-93d0-fd77bb8baf8b None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:44.631052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c9d3-78b3-4791-93d0-fd77bb8baf8b None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:44.631320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5c9d3-78b3-4791-93d0-fd77bb8baf8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:44.641332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5c9d3-78b3-4791-93d0-fd77bb8baf8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-b5d5c9d3-78b3-4791-93d0-fd77bb8baf8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:51:44.646808 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:44.647806 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:44.648813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 445/884] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:44.653900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ee206-6fba-4f2f-aa0e-20024c93e4eb None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:44.669782 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:44.752265 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ee206-6fba-4f2f-aa0e-20024c93e4eb None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:44.786791 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:44.787396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:44.787714 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:44.789533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:44.789533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:44.789533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:44.790597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:44.799044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 440/885] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:44.804833 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5c9d3-78b3-4791-93d0-fd77bb8baf8b None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:44.872487 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:44.904874 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5c9d3-78b3-4791-93d0-fd77bb8baf8b None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:44.937586 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:44.938211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:44.938511 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:44.939384 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:44.949165 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:44.950634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:44.966278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:44.967314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:44.968207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:44.968207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:44.968207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:44.968207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 446/886] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:44.973473 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:45.051997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:45.074231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a40ead-85d9-45f5-bcf2-89fd4cb19382 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:45.105717 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:45.106305 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:45.106609 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:45.106884 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:45.107509 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:45.107811 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:45.109164 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:45.121928 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 441/887] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:45.128385 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:45.229210 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a12de-5631-4f60-9b2b-71a469e14e72 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:45.249086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:45.263323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:45.263944 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:45.264222 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:45.264494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:45.271813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:45.273246 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:51:45.284139 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:45.285236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:45.286416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:45.287250 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 447/888] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:45.293557 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:45.392988 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d097e2-12bc-4167-88c8-ca366f745a0b None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:45.426587 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:45.427170 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:45.427446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:45.427712 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:45.428418 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:45.428716 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:45.430146 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:45.432730 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:45.447083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 442/889] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Aug 19 17:51:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:45.452801 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:45.554239 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1dc4d1-8511-497a-aaca-dba513b800e0 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:45.590896 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:45.591530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:45.591861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:45.592177 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:45.603398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:45.604817 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:45.620273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:45.621393 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:45.622342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:45.622342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:45.622342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:45.622342 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 448/890] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:45.627114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:45.725450 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd28bfa-1eab-4af0-94f1-82140089ad8f None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:45.759505 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:45.760106 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:45.760388 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:45.760703 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:45.761334 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:45.761665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:45.763011 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:45.774752 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 443/891] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:45.780446 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:45.813327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:45.879768 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374cfcd-c4c0-4e02-bdb8-dd45163a8374 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:45.913161 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:45.913811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:45.914354 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:45.914627 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:45.921195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:45.922686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:51:45.933685 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:45.934837 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:45.936116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 449/892] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:45.940790 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:45.996071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:46.040925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6d14e-5200-469d-a39e-9a4ceecb200e None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:46.073119 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a55f51-c776-41ef-82b8-ff277b463abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:46.073781 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55f51-c776-41ef-82b8-ff277b463abe None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:46.074266 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55f51-c776-41ef-82b8-ff277b463abe None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:46.075062 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a55f51-c776-41ef-82b8-ff277b463abe None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:46.075772 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a55f51-c776-41ef-82b8-ff277b463abe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:46.076090 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a55f51-c776-41ef-82b8-ff277b463abe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:46.077559 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a55f51-c776-41ef-82b8-ff277b463abe None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:46.089892 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 444/893] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:46.096413 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:46.191047 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:46.199599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7780f1a-72bc-4424-be82-10e98c561d8a None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:46.232590 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd0c03-38c5-4776-9883-f29178d27f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:46.233236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd0c03-38c5-4776-9883-f29178d27f95 None admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:46.233545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd0c03-38c5-4776-9883-f29178d27f95 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:46.233820 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd0c03-38c5-4776-9883-f29178d27f95 None admin] PATH_INFO: `/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/1b03819209cf40619ba66506a8205b68/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:46.235714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd0c03-38c5-4776-9883-f29178d27f95 None admin] RBAC: Authorizing `identity:create_grant(project_id=0faa0bfd1ad0406eb336f391d6846bbd, user_id=1b03819209cf40619ba66506a8205b68, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:46.237131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd0c03-38c5-4776-9883-f29178d27f95 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:46.333977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 450/894] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Aug 19 17:51:46 2022] PUT /identity/v3/projects/0faa0bfd1ad0406eb336f391d6846bbd/users/1b03819209cf40619ba66506a8205b68/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 17:51:48.509008 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34ef9-b8fa-40b3-a6f0-9024c9d146e9 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:48.509526 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34ef9-b8fa-40b3-a6f0-9024c9d146e9 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:48.509619 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded34ef9-b8fa-40b3-a6f0-9024c9d146e9 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:48.510955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 445/895] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:48.516145 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47e68b-e7b0-45ae-8104-884ef5580678 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:48.516582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47e68b-e7b0-45ae-8104-884ef5580678 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:48.516790 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47e68b-e7b0-45ae-8104-884ef5580678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:48.535559 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-1d47e68b-e7b0-45ae-8104-884ef5580678 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:48.536772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-1d47e68b-e7b0-45ae-8104-884ef5580678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:48.603100 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 451/896] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:48 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:48.936585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34ef9-b8fa-40b3-a6f0-9024c9d146e9 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:49.038279 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded34ef9-b8fa-40b3-a6f0-9024c9d146e9 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:49.053213 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:49.073356 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62e2a-094f-4cef-b966-902a91914abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:49.074006 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62e2a-094f-4cef-b966-902a91914abf None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:49.074286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62e2a-094f-4cef-b966-902a91914abf None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:49.074558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea62e2a-094f-4cef-b966-902a91914abf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:49.084772 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea62e2a-094f-4cef-b966-902a91914abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-0ea62e2a-094f-4cef-b966-902a91914abf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 19 17:51:49.089640 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:49.090816 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:49.091897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 446/897] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Aug 19 17:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:49.097076 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47e68b-e7b0-45ae-8104-884ef5580678 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:49.178067 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:49.197950 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47e68b-e7b0-45ae-8104-884ef5580678 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:49.228453 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:49.229050 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:49.229328 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:49.229634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:49.230293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:49.230594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:49.231979 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:49.240521 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 452/898] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Aug 19 17:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:49.246500 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62e2a-094f-4cef-b966-902a91914abf None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:49.345543 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea62e2a-094f-4cef-b966-902a91914abf None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:49.379773 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:49.380398 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:49.380682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:49.380953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:49.390914 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:49.392562 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:49.406996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:49.408729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:49.409927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:49.409927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:49.409927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:49.409927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 447/899] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 19 17:51:49.414775 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:49.515201 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68dff2f-7a22-4562-bdc3-8cfa50af958f None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:49.549341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:49.549986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:49.550245 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:49.550519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:49.551154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:49.551458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:49.552844 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:49.564510 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 453/900] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 17:51:49.570393 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:49.599275 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:49.673034 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb755d2-114c-46ef-992b-36ffa39f8571 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:49.707319 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:49.707941 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:49.708243 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:49.708521 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:49.715931 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:49.717349 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 19 17:51:49.728754 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:49.729939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:49.731175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 448/901] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:49.735826 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:49.739743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:49.835480 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49990f2b-cbb9-4fb8-adff-9bfd4e3e30ba None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:49.869772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:49.870373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:49.870650 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:49.870918 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:49.871634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:49.871938 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:49.873368 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:49.890316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 454/902] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Aug 19 17:51:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:49.896837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:49.981107 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:49.995668 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d0907-28d4-49c7-a7df-44534110a957 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:50.033576 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838dcb-4df4-4dea-926d-1d7c3675a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:50.034190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838dcb-4df4-4dea-926d-1d7c3675a037 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:50.034655 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838dcb-4df4-4dea-926d-1d7c3675a037 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:50.035096 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54838dcb-4df4-4dea-926d-1d7c3675a037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:50.102222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54838dcb-4df4-4dea-926d-1d7c3675a037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:50.103648 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54838dcb-4df4-4dea-926d-1d7c3675a037 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:50.185373 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:50.200580 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 449/903] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Aug 19 17:51:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 19 17:51:50.207293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:50.270687 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:50.308339 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da9bb-a8e7-4942-944f-66a4f1dcf6b4 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:50.343084 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:50.343712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:50.343987 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:50.344258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:50.354247 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:50.355686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 19 17:51:50.370351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:50.371491 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 19 17:51:50.372599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 19 17:51:50.372599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 19 17:51:50.372599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:50.372599 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 455/904] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 17:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:50.378095 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838dcb-4df4-4dea-926d-1d7c3675a037 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:50.478578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54838dcb-4df4-4dea-926d-1d7c3675a037 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:50.514270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:50.514877 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:50.515153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:50.515425 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:50.516061 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:50.516363 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:50.517793 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:50.528743 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 450/905] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Aug 19 17:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:50.534636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:50.636068 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aeac3-406b-4417-9b11-c6e8dab798f4 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:50.649726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:50.671011 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:50.671644 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:50.671923 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:50.672193 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:50.679636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:50.681089 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 19 17:51:50.692277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:50.698669 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: ERROR keystone.server.flask.application Aug 19 17:51:50.699752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 456/906] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Aug 19 17:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:50.701715 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:50.749727 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:50.802720 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72683083-60fb-4d7a-a161-95986acd3ad8 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:50.836392 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a4fbda-7e50-431d-a48b-236b1b18ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:50.837004 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4fbda-7e50-431d-a48b-236b1b18ac5c None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:50.837307 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4fbda-7e50-431d-a48b-236b1b18ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:50.837612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a4fbda-7e50-431d-a48b-236b1b18ac5c None admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:50.838304 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4fbda-7e50-431d-a48b-236b1b18ac5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:50.838612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4fbda-7e50-431d-a48b-236b1b18ac5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:50.840102 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a4fbda-7e50-431d-a48b-236b1b18ac5c None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:50.852711 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 451/907] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Aug 19 17:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:50.858945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:50.957214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7da3e1-c104-4423-9ee2-e9005ac856f0 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:50.990714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667ac15-69b3-440c-b582-5cf7e6a6181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:50.991310 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667ac15-69b3-440c-b582-5cf7e6a6181c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:50.991587 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667ac15-69b3-440c-b582-5cf7e6a6181c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:50.991860 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667ac15-69b3-440c-b582-5cf7e6a6181c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:50.992568 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667ac15-69b3-440c-b582-5cf7e6a6181c None admin] RBAC: Adding query filter params (role.id=757702b4209942a3b2ec7bf21d995169, scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd, user.id=1b03819209cf40619ba66506a8205b68) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:50.992882 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667ac15-69b3-440c-b582-5cf7e6a6181c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:50.994355 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667ac15-69b3-440c-b582-5cf7e6a6181c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:51.000378 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 457/908] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Aug 19 17:51:50 2022] GET /identity/v3/role_assignments?user.id=1b03819209cf40619ba66506a8205b68&scope.project.id=0faa0bfd1ad0406eb336f391d6846bbd&role.id=757702b4209942a3b2ec7bf21d995169 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:53.242469 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac11b2-5f84-4612-a725-8a539832141d None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:53.243049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac11b2-5f84-4612-a725-8a539832141d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:53.243049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac11b2-5f84-4612-a725-8a539832141d None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:53.244334 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 452/909] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:53.249694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479820d-39c6-492e-8cc8-063910c3f7b5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:53.250072 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479820d-39c6-492e-8cc8-063910c3f7b5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:53.250678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479820d-39c6-492e-8cc8-063910c3f7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:53.269306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-9479820d-39c6-492e-8cc8-063910c3f7b5 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:53.270507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-9479820d-39c6-492e-8cc8-063910c3f7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:53.299967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:53.335356 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 458/910] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 19 17:51:53.663151 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac11b2-5f84-4612-a725-8a539832141d None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:53.764999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac11b2-5f84-4612-a725-8a539832141d None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:53.772651 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:53.799654 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:53.800273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:53.800552 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:53.800824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:53.801405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:53.802833 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:53.811967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:53.815428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:53.816479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 453/911] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Aug 19 17:51:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:53.819320 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479820d-39c6-492e-8cc8-063910c3f7b5 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:53.916474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479820d-39c6-492e-8cc8-063910c3f7b5 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:53.949680 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f856b1-4119-4fec-a800-308e5e6339d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:53.951924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f856b1-4119-4fec-a800-308e5e6339d5 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:53.951924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f856b1-4119-4fec-a800-308e5e6339d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:53.951924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f856b1-4119-4fec-a800-308e5e6339d5 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:53.951924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f856b1-4119-4fec-a800-308e5e6339d5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:53.951924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f856b1-4119-4fec-a800-308e5e6339d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:53.953141 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f856b1-4119-4fec-a800-308e5e6339d5 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:53.957856 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 459/912] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Aug 19 17:51:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:53.963769 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:54.064933 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fef77c-8a90-49f3-9c56-859f11b2a025 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:54.098556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a227-9e22-4d7b-9022-cd198372a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:54.099155 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a227-9e22-4d7b-9022-cd198372a92f None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:54.099436 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a227-9e22-4d7b-9022-cd198372a92f None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:54.099708 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a227-9e22-4d7b-9022-cd198372a92f None admin] PATH_INFO: `/v3/services` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:54.100333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a227-9e22-4d7b-9022-cd198372a92f None admin] RBAC: Adding query filter params (type=placement) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:54.100638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a227-9e22-4d7b-9022-cd198372a92f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:54.102101 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a227-9e22-4d7b-9022-cd198372a92f None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:54.106397 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 454/913] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Aug 19 17:51:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:56.308358 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb139e-ec16-4a9c-89f9-5a75570196b9 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:56.308921 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb139e-ec16-4a9c-89f9-5a75570196b9 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:56.308921 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb139e-ec16-4a9c-89f9-5a75570196b9 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:56.310259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 460/914] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:56.315538 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b3047-61e4-4656-ac11-f40bd1e00b41 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:56.318796 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b3047-61e4-4656-ac11-f40bd1e00b41 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:56.318796 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b3047-61e4-4656-ac11-f40bd1e00b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:56.334692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-4c1b3047-61e4-4656-ac11-f40bd1e00b41 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:56.335867 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-4c1b3047-61e4-4656-ac11-f40bd1e00b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:56.362347 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:56.400515 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 455/915] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:56.732670 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb139e-ec16-4a9c-89f9-5a75570196b9 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:56.763530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:56.834037 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb139e-ec16-4a9c-89f9-5a75570196b9 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:56.868076 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb3f33-57ec-4d00-8b25-3129837303d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:56.868679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb3f33-57ec-4d00-8b25-3129837303d2 None admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:56.868956 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb3f33-57ec-4d00-8b25-3129837303d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:56.869228 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb3f33-57ec-4d00-8b25-3129837303d2 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:56.869900 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb3f33-57ec-4d00-8b25-3129837303d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:56.871261 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb3f33-57ec-4d00-8b25-3129837303d2 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:56.994315 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 461/916] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Aug 19 17:51:56 2022] POST /identity/v3/services => generated 246 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:51:59.173368 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63bfd8-1112-4cde-95d0-45af1423892a None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:59.173960 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63bfd8-1112-4cde-95d0-45af1423892a None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:59.174132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63bfd8-1112-4cde-95d0-45af1423892a None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:59.175787 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 456/917] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:51:59.181315 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a6df-c84b-49f2-9796-a1e7568d54b9 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:59.181750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a6df-c84b-49f2-9796-a1e7568d54b9 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:59.181903 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a6df-c84b-49f2-9796-a1e7568d54b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:59.199922 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-2339a6df-c84b-49f2-9796-a1e7568d54b9 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:51:59.201110 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-2339a6df-c84b-49f2-9796-a1e7568d54b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:51:59.273147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 462/918] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:51:59 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:51:59.600801 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63bfd8-1112-4cde-95d0-45af1423892a None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:59.703868 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63bfd8-1112-4cde-95d0-45af1423892a None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:59.738054 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:59.738734 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:59.738966 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:59.739238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:59.739823 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:59.741209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:51:59.749843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:51:59.751147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:51:59.752287 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 457/919] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Aug 19 17:51:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:51:59.757059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339a6df-c84b-49f2-9796-a1e7568d54b9 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:59.775176 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:51:59.855045 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339a6df-c84b-49f2-9796-a1e7568d54b9 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:51:59.888187 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:51:59.888789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:51:59.889070 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:51:59.889345 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:51:59.890001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:51:59.890305 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:51:59.891707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:51:59.896911 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 463/920] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Aug 19 17:51:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:51:59.903034 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:51:59.933727 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:52:00.003081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b944f-ee2d-4a7d-9a6f-92b657ea20c9 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:52:00.035714 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970cf45-0bf3-4cd0-bcc1-7dc1afa274a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:52:00.036333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970cf45-0bf3-4cd0-bcc1-7dc1afa274a6 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:52:00.036592 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970cf45-0bf3-4cd0-bcc1-7dc1afa274a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:52:00.036865 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970cf45-0bf3-4cd0-bcc1-7dc1afa274a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:52:00.037586 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970cf45-0bf3-4cd0-bcc1-7dc1afa274a6 None admin] RBAC: Adding query filter params (interface=public, service_id=938c7819d11e4866ba121a7c5a50ab64, region_id=RegionOne) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:52:00.037896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970cf45-0bf3-4cd0-bcc1-7dc1afa274a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:52:00.039523 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970cf45-0bf3-4cd0-bcc1-7dc1afa274a6 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:52:00.046642 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 458/921] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Aug 19 17:51:59 2022] GET /identity/v3/endpoints?service_id=938c7819d11e4866ba121a7c5a50ab64&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:52:00.052419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:52:00.133093 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:52:00.151034 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b344b2-aeb6-4cfc-8bbc-c5caae44b0b9 None admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:52:00.184756 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a3ba0-9f3b-4227-ac06-78c01c6f2880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:52:00.185355 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ba0-9f3b-4227-ac06-78c01c6f2880 None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:52:00.185714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ba0-9f3b-4227-ac06-78c01c6f2880 None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:52:00.185985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a3ba0-9f3b-4227-ac06-78c01c6f2880 None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:52:00.186578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3ba0-9f3b-4227-ac06-78c01c6f2880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:52:00.187948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a3ba0-9f3b-4227-ac06-78c01c6f2880 None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:52:00.194384 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 464/922] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Aug 19 17:52:00 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 17:52:02.399856 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c184-2919-4603-9a60-04ca07d79b69 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:52:02.400389 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c184-2919-4603-9a60-04ca07d79b69 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:52:02.400389 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628c184-2919-4603-9a60-04ca07d79b69 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:52:02.401763 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 459/923] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:52:02.406959 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83232c24-8f63-471d-8c11-5b765e3ff47e None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:52:02.407333 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83232c24-8f63-471d-8c11-5b765e3ff47e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:52:02.407513 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83232c24-8f63-471d-8c11-5b765e3ff47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:52:02.426198 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-83232c24-8f63-471d-8c11-5b765e3ff47e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:52:02.427432 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-83232c24-8f63-471d-8c11-5b765e3ff47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:52:02.496506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 465/924] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:52:02 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 19 17:52:02.830890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628c184-2919-4603-9a60-04ca07d79b69 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:52:02.930865 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:52:02.940650 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628c184-2919-4603-9a60-04ca07d79b69 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:52:02.974575 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:52:02.975202 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:52:02.975480 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:52:02.975752 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:52:02.976335 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:52:02.977731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 19 17:52:02.986195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 19 17:52:02.987511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.get_or_create( Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application with Lock( Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self._enter() Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application return self.creator() Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application created_value = creator( Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: ERROR keystone.server.flask.application Aug 19 17:52:02.988597 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 460/925] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Aug 19 17:52:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 19 17:52:02.995048 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83232c24-8f63-471d-8c11-5b765e3ff47e None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:52:03.071237 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:52:03.093095 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83232c24-8f63-471d-8c11-5b765e3ff47e None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:52:03.126005 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c807c-368a-4d39-a6d5-82b37644b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:52:03.126604 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c807c-368a-4d39-a6d5-82b37644b41c None admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:52:03.127637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c807c-368a-4d39-a6d5-82b37644b41c None admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:52:03.128085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c807c-368a-4d39-a6d5-82b37644b41c None admin] PATH_INFO: `/v3/services` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:52:03.128706 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c807c-368a-4d39-a6d5-82b37644b41c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 17:52:03.129008 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c807c-368a-4d39-a6d5-82b37644b41c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:52:03.130408 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c807c-368a-4d39-a6d5-82b37644b41c None admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:52:03.135216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 466/926] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Aug 19 17:52:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 17:52:03.141072 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:52:03.240997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416869a-94fe-4367-a4a2-89953d0d9840 None admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:52:03.274063 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb4435-3ce2-4627-9bcd-10866396a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:52:03.274665 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4435-3ce2-4627-9bcd-10866396a329 None admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:52:03.274945 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4435-3ce2-4627-9bcd-10866396a329 None admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:52:03.275222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4435-3ce2-4627-9bcd-10866396a329 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:52:03.275876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb4435-3ce2-4627-9bcd-10866396a329 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:52:03.277241 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb4435-3ce2-4627-9bcd-10866396a329 None admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:52:03.379379 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 461/927] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 17:52:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 17:52:13.148557 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=30 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:52:13.372250 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:58:02.890152 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cce1ec-43ac-4aa4-90a4-8e0066b96244 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:02.891224 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cce1ec-43ac-4aa4-90a4-8e0066b96244 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:02.891640 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cce1ec-43ac-4aa4-90a4-8e0066b96244 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:02.893147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 467/928] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:02.898637 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f1b6-83ae-442c-8fa4-7e842aa5775e None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:02.899094 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f1b6-83ae-442c-8fa4-7e842aa5775e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:02.899191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f1b6-83ae-442c-8fa4-7e842aa5775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:03.021484 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e989f1b6-83ae-442c-8fa4-7e842aa5775e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:03.022970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e989f1b6-83ae-442c-8fa4-7e842aa5775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:03.147978 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 462/929] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:03.523232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcffa5a-9414-4df9-a4e1-d8fc6620fe1e None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:03.523513 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcffa5a-9414-4df9-a4e1-d8fc6620fe1e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:03.523784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcffa5a-9414-4df9-a4e1-d8fc6620fe1e None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:03.525160 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 468/930] 10.222.0.48 () {54 vars in 965 bytes} [Fri Aug 19 17:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:03.531459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562992d-3209-46c6-98a2-88b88126d8f9 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:03.531742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562992d-3209-46c6-98a2-88b88126d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:03.532026 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562992d-3209-46c6-98a2-88b88126d8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:03.593798 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e562992d-3209-46c6-98a2-88b88126d8f9 None None] MFA Rules not processed for user `b864fd056be54f2986135bbb77bdf7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:03.595042 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e562992d-3209-46c6-98a2-88b88126d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:03.638197 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:58:03.673216 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 463/931] 10.222.0.48 () {58 vars in 1062 bytes} [Fri Aug 19 17:58:03 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:58:03.682195 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcffa5a-9414-4df9-a4e1-d8fc6620fe1e None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:03.693796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcffa5a-9414-4df9-a4e1-d8fc6620fe1e None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:03.697460 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bef130-cc28-48b6-929b-cae832fef077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:03.698086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef130-cc28-48b6-929b-cae832fef077 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:03.698386 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef130-cc28-48b6-929b-cae832fef077 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:03.698826 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bef130-cc28-48b6-929b-cae832fef077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:03.708902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bef130-cc28-48b6-929b-cae832fef077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:03.710401 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bef130-cc28-48b6-929b-cae832fef077 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:03.721505 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 469/932] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:06.203960 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e78d2b-ce4f-4334-879c-44b9e03af437 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:06.204499 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e78d2b-ce4f-4334-879c-44b9e03af437 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:06.204499 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e78d2b-ce4f-4334-879c-44b9e03af437 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:06.205898 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 464/933] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:06.211096 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ca07-e60b-4780-a4e0-7bfd8b7dd60f None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:06.211507 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ca07-e60b-4780-a4e0-7bfd8b7dd60f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:06.211761 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4ca07-e60b-4780-a4e0-7bfd8b7dd60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:06.232590 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-47f4ca07-e60b-4780-a4e0-7bfd8b7dd60f None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:06.233873 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-47f4ca07-e60b-4780-a4e0-7bfd8b7dd60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:06.242214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 470/934] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:58:06.593422 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e78d2b-ce4f-4334-879c-44b9e03af437 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:06.603978 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e78d2b-ce4f-4334-879c-44b9e03af437 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:06.607493 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70a246-c72d-488c-85b5-4c6b85d73d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:06.608088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70a246-c72d-488c-85b5-4c6b85d73d47 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:06.608370 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70a246-c72d-488c-85b5-4c6b85d73d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:06.608646 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70a246-c72d-488c-85b5-4c6b85d73d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:06.617405 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70a246-c72d-488c-85b5-4c6b85d73d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:06.618927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70a246-c72d-488c-85b5-4c6b85d73d47 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:06.628588 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 465/935] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:09.299786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e37ff-4ee5-429a-8e83-d6d013026c6f None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:09.300332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e37ff-4ee5-429a-8e83-d6d013026c6f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:09.300332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e37ff-4ee5-429a-8e83-d6d013026c6f None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:09.303682 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 471/936] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:09.307040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c24c1-cd2b-4968-8c1a-0581c06c3ad1 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:09.307475 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c24c1-cd2b-4968-8c1a-0581c06c3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:09.307619 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c24c1-cd2b-4968-8c1a-0581c06c3ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:09.371271 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-769c24c1-cd2b-4968-8c1a-0581c06c3ad1 None None] MFA Rules not processed for user `988d7b945dab46e599712b0e1891d3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:09.372634 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-769c24c1-cd2b-4968-8c1a-0581c06c3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:09.469471 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 466/937] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:09 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:09.812501 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e37ff-4ee5-429a-8e83-d6d013026c6f None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:09.824325 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e37ff-4ee5-429a-8e83-d6d013026c6f None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:09.828418 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b761eec-1173-438a-ab3e-9fe0d059dbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:09.829042 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761eec-1173-438a-ab3e-9fe0d059dbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:09.829316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761eec-1173-438a-ab3e-9fe0d059dbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:09.829800 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761eec-1173-438a-ab3e-9fe0d059dbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:09.840279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b761eec-1173-438a-ab3e-9fe0d059dbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:09.841846 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b761eec-1173-438a-ab3e-9fe0d059dbc1 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:09.853023 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 472/938] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:09 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:13.174692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835a28-8243-4c7f-bde2-fd3bc19a0784 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:13.175245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835a28-8243-4c7f-bde2-fd3bc19a0784 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:13.175245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835a28-8243-4c7f-bde2-fd3bc19a0784 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:13.176758 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 467/939] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:13.181973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcb175-f717-4e07-8a11-9d18f3f75353 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:13.182347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcb175-f717-4e07-8a11-9d18f3f75353 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:13.182512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcb175-f717-4e07-8a11-9d18f3f75353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:13.201777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c1fcb175-f717-4e07-8a11-9d18f3f75353 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:13.202945 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c1fcb175-f717-4e07-8a11-9d18f3f75353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:13.268089 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 473/940] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:13 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:13.634839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be27c-0c51-4dae-85f7-50d337bbe69c None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:13.635238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be27c-0c51-4dae-85f7-50d337bbe69c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:13.635529 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be27c-0c51-4dae-85f7-50d337bbe69c None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:13.637644 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 468/941] 10.222.0.48 () {54 vars in 965 bytes} [Fri Aug 19 17:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:13.643660 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beeabd-d29c-4607-a713-35ebe5cc70bb None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:13.643947 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beeabd-d29c-4607-a713-35ebe5cc70bb None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:13.644228 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beeabd-d29c-4607-a713-35ebe5cc70bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:13.663609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-45beeabd-d29c-4607-a713-35ebe5cc70bb None None] MFA Rules not processed for user `b864fd056be54f2986135bbb77bdf7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:13.664786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-45beeabd-d29c-4607-a713-35ebe5cc70bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:13.671247 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 474/942] 10.222.0.48 () {58 vars in 1062 bytes} [Fri Aug 19 17:58:13 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:13.680171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be27c-0c51-4dae-85f7-50d337bbe69c None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:13.691274 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be27c-0c51-4dae-85f7-50d337bbe69c None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:13.694768 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff949d37-f9e5-4008-a3bb-bd97b94c8054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:13.695358 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949d37-f9e5-4008-a3bb-bd97b94c8054 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:13.695637 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949d37-f9e5-4008-a3bb-bd97b94c8054 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:13.695909 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff949d37-f9e5-4008-a3bb-bd97b94c8054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:13.705261 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff949d37-f9e5-4008-a3bb-bd97b94c8054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:13.706741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff949d37-f9e5-4008-a3bb-bd97b94c8054 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:13.716254 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 469/943] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:13 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:17.378886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65d2f-6f1c-46ae-8ace-e335528441e4 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:17.379438 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65d2f-6f1c-46ae-8ace-e335528441e4 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:17.379555 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65d2f-6f1c-46ae-8ace-e335528441e4 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:17.380859 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 475/944] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:17.386555 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa947-6102-450b-9ba1-f7e249d8c051 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:17.386997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa947-6102-450b-9ba1-f7e249d8c051 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:17.387090 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa947-6102-450b-9ba1-f7e249d8c051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:17.406670 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-1d6fa947-6102-450b-9ba1-f7e249d8c051 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:17.410837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-1d6fa947-6102-450b-9ba1-f7e249d8c051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:17.416319 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 470/945] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:17.763848 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb65d2f-6f1c-46ae-8ace-e335528441e4 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:17.774464 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb65d2f-6f1c-46ae-8ace-e335528441e4 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:17.778566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1f341-bce4-4fad-b8c8-b42c35141534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:17.779154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f341-bce4-4fad-b8c8-b42c35141534 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:17.779428 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f341-bce4-4fad-b8c8-b42c35141534 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:17.779698 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f341-bce4-4fad-b8c8-b42c35141534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:17.788549 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1f341-bce4-4fad-b8c8-b42c35141534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:17.790008 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1f341-bce4-4fad-b8c8-b42c35141534 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:17.799190 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 476/946] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:20.027535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a504f-a964-4141-92ac-997175c1313e None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:20.028099 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a504f-a964-4141-92ac-997175c1313e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:20.028099 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a504f-a964-4141-92ac-997175c1313e None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:20.029398 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 471/947] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:20.034672 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eac21-43b5-469e-aebd-5269ee91f6f5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:20.035117 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eac21-43b5-469e-aebd-5269ee91f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:20.035210 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138eac21-43b5-469e-aebd-5269ee91f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:20.054707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-138eac21-43b5-469e-aebd-5269ee91f6f5 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:20.055874 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-138eac21-43b5-469e-aebd-5269ee91f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:20.064071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 477/948] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:20.402198 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a504f-a964-4141-92ac-997175c1313e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:20.413152 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a504f-a964-4141-92ac-997175c1313e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:20.416684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded10afa-d75b-41ab-90f4-80579e867cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:20.417901 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10afa-d75b-41ab-90f4-80579e867cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:20.418172 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10afa-d75b-41ab-90f4-80579e867cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:20.420475 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded10afa-d75b-41ab-90f4-80579e867cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:20.427554 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded10afa-d75b-41ab-90f4-80579e867cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:20.428971 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded10afa-d75b-41ab-90f4-80579e867cf8 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:20.438674 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 472/949] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:22.684370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849a9a-61b5-4fac-9c0d-1ce8e7b32294 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:22.684895 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849a9a-61b5-4fac-9c0d-1ce8e7b32294 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:22.684895 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac849a9a-61b5-4fac-9c0d-1ce8e7b32294 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:22.686264 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 478/950] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:22.691335 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb62c4-0a05-4d7f-b2ed-a96a16ad7f34 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:22.691757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb62c4-0a05-4d7f-b2ed-a96a16ad7f34 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:22.691884 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb62c4-0a05-4d7f-b2ed-a96a16ad7f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:22.710839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-7adb62c4-0a05-4d7f-b2ed-a96a16ad7f34 None None] MFA Rules not processed for user `988d7b945dab46e599712b0e1891d3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:22.712015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-7adb62c4-0a05-4d7f-b2ed-a96a16ad7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:22.720456 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 473/951] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:22 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:23.063735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849a9a-61b5-4fac-9c0d-1ce8e7b32294 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:23.074589 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac849a9a-61b5-4fac-9c0d-1ce8e7b32294 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:23.078059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e0096-f748-4a1d-8d9a-37461534ae94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:23.078656 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e0096-f748-4a1d-8d9a-37461534ae94 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:23.078932 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e0096-f748-4a1d-8d9a-37461534ae94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:23.079204 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e0096-f748-4a1d-8d9a-37461534ae94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:23.088159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e0096-f748-4a1d-8d9a-37461534ae94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:23.089651 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e0096-f748-4a1d-8d9a-37461534ae94 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:23.099067 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 479/952] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:23 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:25.797242 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c576-60c1-4d7a-952d-0cf14fc52cf8 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:25.797800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c576-60c1-4d7a-952d-0cf14fc52cf8 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:25.797800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c576-60c1-4d7a-952d-0cf14fc52cf8 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:25.799136 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 474/953] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:25.804349 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6d0f-751a-4999-b926-0b7c734ac1b6 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:25.804772 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6d0f-751a-4999-b926-0b7c734ac1b6 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:25.805011 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f6d0f-751a-4999-b926-0b7c734ac1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:25.824498 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-ab1f6d0f-751a-4999-b926-0b7c734ac1b6 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:25.825713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-ab1f6d0f-751a-4999-b926-0b7c734ac1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:25.833275 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 480/954] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:26.176957 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c576-60c1-4d7a-952d-0cf14fc52cf8 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:26.187731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c576-60c1-4d7a-952d-0cf14fc52cf8 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:26.191272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb69482-4de2-4608-a628-3e0c425e335b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:26.191866 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb69482-4de2-4608-a628-3e0c425e335b service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:26.192144 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb69482-4de2-4608-a628-3e0c425e335b service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:26.192416 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb69482-4de2-4608-a628-3e0c425e335b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:26.201806 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb69482-4de2-4608-a628-3e0c425e335b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:26.203274 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb69482-4de2-4608-a628-3e0c425e335b service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:26.212876 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 475/955] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:28.450421 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4a55-1219-42fe-8536-671034621d38 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:28.450901 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4a55-1219-42fe-8536-671034621d38 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:28.450988 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4a55-1219-42fe-8536-671034621d38 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:28.452306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 481/956] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:28.457537 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a438-de5f-469a-a662-487677de862c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:28.457951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a438-de5f-469a-a662-487677de862c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:28.458153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a438-de5f-469a-a662-487677de862c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:28.477282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d341a438-de5f-469a-a662-487677de862c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:28.478490 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d341a438-de5f-469a-a662-487677de862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:28.493821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 476/957] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:28.839186 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af4a55-1219-42fe-8536-671034621d38 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:28.850230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af4a55-1219-42fe-8536-671034621d38 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:28.853742 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676d0d0-7a84-42fc-a600-9aebaf8f28e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:28.854955 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676d0d0-7a84-42fc-a600-9aebaf8f28e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:28.855229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676d0d0-7a84-42fc-a600-9aebaf8f28e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:28.855493 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676d0d0-7a84-42fc-a600-9aebaf8f28e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:28.865145 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676d0d0-7a84-42fc-a600-9aebaf8f28e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:28.866638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676d0d0-7a84-42fc-a600-9aebaf8f28e8 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:28.878759 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 482/958] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:31.775731 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171133-ffe7-4863-8794-380ccffa889e None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:31.776277 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171133-ffe7-4863-8794-380ccffa889e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:31.776277 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171133-ffe7-4863-8794-380ccffa889e None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:31.777650 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 477/959] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:31.782853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62be02-7941-4c96-bb29-c65c5879e23e None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:31.783273 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62be02-7941-4c96-bb29-c65c5879e23e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:31.783399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62be02-7941-4c96-bb29-c65c5879e23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:31.802530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-0a62be02-7941-4c96-bb29-c65c5879e23e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:31.803691 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-0a62be02-7941-4c96-bb29-c65c5879e23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:31.812280 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 483/960] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:31 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:58:32.151784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171133-ffe7-4863-8794-380ccffa889e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:32.157074 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:58:32.163132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171133-ffe7-4863-8794-380ccffa889e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:32.166617 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07436032-f124-42da-abaf-fbd73bea0267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:32.167206 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436032-f124-42da-abaf-fbd73bea0267 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:32.167486 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436032-f124-42da-abaf-fbd73bea0267 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:32.167757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07436032-f124-42da-abaf-fbd73bea0267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:32.176359 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07436032-f124-42da-abaf-fbd73bea0267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:32.177909 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07436032-f124-42da-abaf-fbd73bea0267 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:32.187479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 478/961] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:32 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:36.712631 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177c755-2e6e-4441-a921-a2c328a76ef1 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:36.713206 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177c755-2e6e-4441-a921-a2c328a76ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:36.713206 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3177c755-2e6e-4441-a921-a2c328a76ef1 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:36.715329 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 484/962] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:36.720703 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8d4b-74ed-4a7c-915e-b3050e9efb3c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:36.721126 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8d4b-74ed-4a7c-915e-b3050e9efb3c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:36.721266 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8d4b-74ed-4a7c-915e-b3050e9efb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:36.742034 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-923e8d4b-74ed-4a7c-915e-b3050e9efb3c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:36.743209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-923e8d4b-74ed-4a7c-915e-b3050e9efb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:36.751421 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 479/963] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:58:37.092157 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177c755-2e6e-4441-a921-a2c328a76ef1 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:37.097477 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=77 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:58:37.103133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3177c755-2e6e-4441-a921-a2c328a76ef1 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:37.106812 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d1cba-37d2-4f3f-a3a3-95188628040d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:37.113975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1cba-37d2-4f3f-a3a3-95188628040d service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:37.113975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1cba-37d2-4f3f-a3a3-95188628040d service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:37.113975 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d1cba-37d2-4f3f-a3a3-95188628040d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:37.116977 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d1cba-37d2-4f3f-a3a3-95188628040d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:37.118426 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d1cba-37d2-4f3f-a3a3-95188628040d service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:37.127714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 485/964] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:40.291529 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad67f-35ae-4194-8285-67640b0d624d None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:40.292284 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad67f-35ae-4194-8285-67640b0d624d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:40.292284 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad67f-35ae-4194-8285-67640b0d624d None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:40.293558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 480/965] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:40.298817 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5ef7-26d1-4677-8b24-cdad0fbed9a6 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:40.299212 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5ef7-26d1-4677-8b24-cdad0fbed9a6 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:40.299428 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d5ef7-26d1-4677-8b24-cdad0fbed9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:40.318302 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-914d5ef7-26d1-4677-8b24-cdad0fbed9a6 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:40.319476 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-914d5ef7-26d1-4677-8b24-cdad0fbed9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:40.327938 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 486/966] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:40 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:40.674747 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ad67f-35ae-4194-8285-67640b0d624d None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:40.686069 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ad67f-35ae-4194-8285-67640b0d624d None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:40.689589 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5b6b9-3fcd-4159-89ef-a6798a67a6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:40.690186 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b6b9-3fcd-4159-89ef-a6798a67a6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:40.690459 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b6b9-3fcd-4159-89ef-a6798a67a6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:40.690728 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5b6b9-3fcd-4159-89ef-a6798a67a6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:40.700331 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5b6b9-3fcd-4159-89ef-a6798a67a6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:40.701777 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5b6b9-3fcd-4159-89ef-a6798a67a6c4 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:40.711027 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 481/967] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:40 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:45.139481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080632e0-034c-4576-8d50-8bb8ff91935c None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:45.140001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080632e0-034c-4576-8d50-8bb8ff91935c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:45.140001 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080632e0-034c-4576-8d50-8bb8ff91935c None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:45.141347 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 487/968] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:45.146424 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e9e0-6c56-4508-b3e0-93986e37ef73 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:45.146940 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e9e0-6c56-4508-b3e0-93986e37ef73 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:45.147043 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26e9e0-6c56-4508-b3e0-93986e37ef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:45.167268 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-9f26e9e0-6c56-4508-b3e0-93986e37ef73 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:45.168442 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-9f26e9e0-6c56-4508-b3e0-93986e37ef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:45.176143 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 482/969] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:58:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 17:58:45.522781 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080632e0-034c-4576-8d50-8bb8ff91935c None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:58:45.533621 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080632e0-034c-4576-8d50-8bb8ff91935c None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:58:45.537308 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65ebff-d186-4a2c-b8ed-1ae62dc521bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:58:45.538625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ebff-d186-4a2c-b8ed-1ae62dc521bd service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:45.538625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ebff-d186-4a2c-b8ed-1ae62dc521bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:45.538625 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ebff-d186-4a2c-b8ed-1ae62dc521bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:45.548623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65ebff-d186-4a2c-b8ed-1ae62dc521bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:58:45.550178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65ebff-d186-4a2c-b8ed-1ae62dc521bd service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:58:45.560969 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 488/970] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:58:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:58:51.082446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ec740-9e29-4c2d-891a-f397832ff243 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:51.083394 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ec740-9e29-4c2d-891a-f397832ff243 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:51.083866 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ec740-9e29-4c2d-891a-f397832ff243 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:51.085682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 483/971] 10.222.0.48 () {54 vars in 921 bytes} [Fri Aug 19 17:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:51.091488 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724237e-9467-4752-9248-c82851eea0b3 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:51.092351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724237e-9467-4752-9248-c82851eea0b3 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:51.092832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724237e-9467-4752-9248-c82851eea0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:51.144212 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-0724237e-9467-4752-9248-c82851eea0b3 None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:51.145757 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-0724237e-9467-4752-9248-c82851eea0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:51.222382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 489/972] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Aug 19 17:58:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:55.162032 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=17 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:58:55.751789 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1090-5bc5-440f-8a6e-0800ce501864 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:55.751789 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1090-5bc5-440f-8a6e-0800ce501864 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:55.751789 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1090-5bc5-440f-8a6e-0800ce501864 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:55.753214 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 484/973] 10.222.0.48 () {54 vars in 921 bytes} [Fri Aug 19 17:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:55.758102 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cbbc9-749b-4632-9ed7-a623cfc59018 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:55.758582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cbbc9-749b-4632-9ed7-a623cfc59018 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:55.758843 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7cbbc9-749b-4632-9ed7-a623cfc59018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:55.780442 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-8e7cbbc9-749b-4632-9ed7-a623cfc59018 None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:55.781784 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-8e7cbbc9-749b-4632-9ed7-a623cfc59018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:55.790565 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 490/974] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Aug 19 17:58:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:58:57.448148 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30129ac-8f11-4f7b-9b48-727daf102fb4 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:57.448697 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30129ac-8f11-4f7b-9b48-727daf102fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:57.448697 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30129ac-8f11-4f7b-9b48-727daf102fb4 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:57.450059 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 485/975] 10.222.0.48 () {54 vars in 921 bytes} [Fri Aug 19 17:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:58:57.455327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecea06c-a35e-4d4e-add9-1e3a6c331b18 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:58:57.455759 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecea06c-a35e-4d4e-add9-1e3a6c331b18 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:58:57.455998 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecea06c-a35e-4d4e-add9-1e3a6c331b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:58:57.478814 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-1ecea06c-a35e-4d4e-add9-1e3a6c331b18 None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:58:57.479992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-1ecea06c-a35e-4d4e-add9-1e3a6c331b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:58:57.490601 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 491/976] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Aug 19 17:58:57 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:01.383174 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4219-1678-4a8d-a86e-1b2f7f38df8b None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:01.384050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4219-1678-4a8d-a86e-1b2f7f38df8b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:01.384383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e4219-1678-4a8d-a86e-1b2f7f38df8b None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:01.385910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 486/977] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:01.391465 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827483c-92b6-4faa-9a71-a1f60d69596d None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:01.391952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827483c-92b6-4faa-9a71-a1f60d69596d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:01.392053 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827483c-92b6-4faa-9a71-a1f60d69596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:01.416281 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-a827483c-92b6-4faa-9a71-a1f60d69596d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:01.417818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-a827483c-92b6-4faa-9a71-a1f60d69596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:01.426913 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 492/978] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:01.800396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177defb-7b08-4894-a74c-104a557534fe None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:01.801565 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177defb-7b08-4894-a74c-104a557534fe None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:01.802136 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177defb-7b08-4894-a74c-104a557534fe None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:01.805245 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 487/979] 10.222.0.48 () {54 vars in 962 bytes} [Fri Aug 19 17:59:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:01.813324 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab601e2-d757-4e6d-b842-83828b153c85 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:01.813607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab601e2-d757-4e6d-b842-83828b153c85 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:01.813882 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab601e2-d757-4e6d-b842-83828b153c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:01.851148 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-9ab601e2-d757-4e6d-b842-83828b153c85 None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:01.852333 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-9ab601e2-d757-4e6d-b842-83828b153c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:01.923798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:59:01.929559 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 493/980] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Aug 19 17:59:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:01.937557 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177defb-7b08-4894-a74c-104a557534fe None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:01.951213 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177defb-7b08-4894-a74c-104a557534fe None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:01.956301 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339a57c-f610-4fe6-8b7c-38a670102471 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:01.957108 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339a57c-f610-4fe6-8b7c-38a670102471 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:01.957386 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339a57c-f610-4fe6-8b7c-38a670102471 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:01.957693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339a57c-f610-4fe6-8b7c-38a670102471 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:01.966307 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339a57c-f610-4fe6-8b7c-38a670102471 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:01.968006 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339a57c-f610-4fe6-8b7c-38a670102471 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:01.977753 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 488/981] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:04.406460 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84417f-adc3-4073-a610-12e8e44d4542 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:04.407079 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84417f-adc3-4073-a610-12e8e44d4542 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:04.407079 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84417f-adc3-4073-a610-12e8e44d4542 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:04.408488 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 494/982] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:04.413928 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfc23-8c4b-4985-b22b-cc114ca7250b None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:04.415111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfc23-8c4b-4985-b22b-cc114ca7250b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:04.415111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfc23-8c4b-4985-b22b-cc114ca7250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:04.434821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-cd3bfc23-8c4b-4985-b22b-cc114ca7250b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:04.436029 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-cd3bfc23-8c4b-4985-b22b-cc114ca7250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:04.443810 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 489/983] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:04.795677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84417f-adc3-4073-a610-12e8e44d4542 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:04.810626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84417f-adc3-4073-a610-12e8e44d4542 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:04.816861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a815a-0581-4d02-b152-cb2f52264644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:04.816861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a815a-0581-4d02-b152-cb2f52264644 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:04.816861 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a815a-0581-4d02-b152-cb2f52264644 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:04.817123 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a815a-0581-4d02-b152-cb2f52264644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:04.825961 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a815a-0581-4d02-b152-cb2f52264644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:04.827735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a815a-0581-4d02-b152-cb2f52264644 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:04.838404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 495/984] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:07.544120 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f5eb-95a8-43ec-b7b3-314864bad2da None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:07.546177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f5eb-95a8-43ec-b7b3-314864bad2da None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:07.546177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f5eb-95a8-43ec-b7b3-314864bad2da None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:07.546177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 490/985] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:07.551534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76941-8e4d-40e3-ba5c-f049c134c484 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:07.552005 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76941-8e4d-40e3-ba5c-f049c134c484 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:07.552161 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e76941-8e4d-40e3-ba5c-f049c134c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:07.572153 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-96e76941-8e4d-40e3-ba5c-f049c134c484 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:07.573409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-96e76941-8e4d-40e3-ba5c-f049c134c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:07.581971 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 496/986] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:07.936244 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece7b03-3836-4df5-8e41-454ca809ae7d None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:07.936686 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece7b03-3836-4df5-8e41-454ca809ae7d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:07.937140 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece7b03-3836-4df5-8e41-454ca809ae7d None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:07.938594 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 491/987] 10.222.0.48 () {54 vars in 962 bytes} [Fri Aug 19 17:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:07.944223 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84c1e-8026-481f-994f-ee437749590b None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:07.944512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84c1e-8026-481f-994f-ee437749590b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:07.944790 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e84c1e-8026-481f-994f-ee437749590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:07.966211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c7e84c1e-8026-481f-994f-ee437749590b None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:07.967458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c7e84c1e-8026-481f-994f-ee437749590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:07.977103 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 497/988] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Aug 19 17:59:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:07.985646 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece7b03-3836-4df5-8e41-454ca809ae7d None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:08.000963 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece7b03-3836-4df5-8e41-454ca809ae7d None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:08.006190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9d969-0d1e-4a52-bbaa-9d481786ece0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:08.006870 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d969-0d1e-4a52-bbaa-9d481786ece0 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:08.007215 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d969-0d1e-4a52-bbaa-9d481786ece0 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:08.007550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9d969-0d1e-4a52-bbaa-9d481786ece0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:08.016925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d969-0d1e-4a52-bbaa-9d481786ece0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:08.018570 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9d969-0d1e-4a52-bbaa-9d481786ece0 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:08.028710 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 492/989] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:10.499463 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5a81c-9875-4ebf-b977-c80513b30ebe None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:10.499937 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5a81c-9875-4ebf-b977-c80513b30ebe None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:10.500058 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5a81c-9875-4ebf-b977-c80513b30ebe None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:10.501377 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 498/990] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:10.506899 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8558-3cd5-42a4-973d-5811ca681a76 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:10.507762 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8558-3cd5-42a4-973d-5811ca681a76 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:10.508246 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8558-3cd5-42a4-973d-5811ca681a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:10.531516 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-af1f8558-3cd5-42a4-973d-5811ca681a76 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:10.533076 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-af1f8558-3cd5-42a4-973d-5811ca681a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:10.551475 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 493/991] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:10.920700 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5a81c-9875-4ebf-b977-c80513b30ebe None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:10.936200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5a81c-9875-4ebf-b977-c80513b30ebe None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:10.941864 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd720e-5739-458b-a5b1-4c8dde7256a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:10.942700 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd720e-5739-458b-a5b1-4c8dde7256a7 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:10.943214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd720e-5739-458b-a5b1-4c8dde7256a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:10.943689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd720e-5739-458b-a5b1-4c8dde7256a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:10.953789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd720e-5739-458b-a5b1-4c8dde7256a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:10.955868 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd720e-5739-458b-a5b1-4c8dde7256a7 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:10.978344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 499/992] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:11.938677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f09ef9-5802-4c66-97fc-2203c8cd65e8 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:11.940024 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f09ef9-5802-4c66-97fc-2203c8cd65e8 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:11.940847 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f09ef9-5802-4c66-97fc-2203c8cd65e8 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:11.949514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 494/993] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:11.949935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153699-4449-434b-a564-a9174bd033b0 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:11.950341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153699-4449-434b-a564-a9174bd033b0 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:11.950479 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5153699-4449-434b-a564-a9174bd033b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:11.983422 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-d5153699-4449-434b-a564-a9174bd033b0 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:11.985480 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-d5153699-4449-434b-a564-a9174bd033b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:12.000988 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 500/994] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:12.644140 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f0d9e-0346-4c09-883f-8fe35ccebde4 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:12.644783 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f0d9e-0346-4c09-883f-8fe35ccebde4 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:12.645613 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f0d9e-0346-4c09-883f-8fe35ccebde4 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:12.647458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 495/995] 10.222.0.48 () {54 vars in 964 bytes} [Fri Aug 19 17:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:12.653626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b82c0-e096-434e-9f85-f58797eebe44 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:12.654245 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b82c0-e096-434e-9f85-f58797eebe44 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:12.654884 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b82c0-e096-434e-9f85-f58797eebe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:12.709355 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-7e3b82c0-e096-434e-9f85-f58797eebe44 None None] MFA Rules not processed for user `7fb05df536de4b159101ffa5cc41c5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:12.711133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-7e3b82c0-e096-434e-9f85-f58797eebe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:12.787096 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 501/996] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Aug 19 17:59:12 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:12.794500 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f0d9e-0346-4c09-883f-8fe35ccebde4 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:12.806848 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f0d9e-0346-4c09-883f-8fe35ccebde4 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:12.811221 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f505afd-b18f-4647-bd37-f05fb08ab14e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb05df536de4b159101ffa5cc41c5ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:12.812284 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505afd-b18f-4647-bd37-f05fb08ab14e service cinder] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:12.813065 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505afd-b18f-4647-bd37-f05fb08ab14e service cinder] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:12.813573 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f505afd-b18f-4647-bd37-f05fb08ab14e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:12.828383 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505afd-b18f-4647-bd37-f05fb08ab14e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:12.830644 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f505afd-b18f-4647-bd37-f05fb08ab14e service cinder] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:12.848016 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 496/997] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:13.476621 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565564-0c7b-4dee-b24b-f2ca4876cb36 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:13.477152 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565564-0c7b-4dee-b24b-f2ca4876cb36 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:13.477369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d565564-0c7b-4dee-b24b-f2ca4876cb36 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:13.479474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 502/998] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:13.485672 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c081d5-64e7-432c-a056-2932ac0b4650 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:13.487092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c081d5-64e7-432c-a056-2932ac0b4650 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:13.487542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c081d5-64e7-432c-a056-2932ac0b4650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:13.510600 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d2c081d5-64e7-432c-a056-2932ac0b4650 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:13.511853 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d2c081d5-64e7-432c-a056-2932ac0b4650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:13.519839 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 497/999] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:13.872220 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565564-0c7b-4dee-b24b-f2ca4876cb36 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:13.890921 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d565564-0c7b-4dee-b24b-f2ca4876cb36 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:13.896670 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851831f-a06e-458e-975a-e57b76abded2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:13.897461 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851831f-a06e-458e-975a-e57b76abded2 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:13.897832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851831f-a06e-458e-975a-e57b76abded2 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:13.898200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851831f-a06e-458e-975a-e57b76abded2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:13.912930 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851831f-a06e-458e-975a-e57b76abded2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:13.915676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851831f-a06e-458e-975a-e57b76abded2 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:13.929114 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 503/1000] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:16.297546 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccb0ce-4547-4479-b821-07af8d8b567c None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:16.298375 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccb0ce-4547-4479-b821-07af8d8b567c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:16.298837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ccb0ce-4547-4479-b821-07af8d8b567c None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:16.300580 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 498/1001] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:16.305848 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d0f63-e2fa-4c8b-87c8-588ab2189539 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:16.306270 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d0f63-e2fa-4c8b-87c8-588ab2189539 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:16.306485 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d0f63-e2fa-4c8b-87c8-588ab2189539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:16.326403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c34d0f63-e2fa-4c8b-87c8-588ab2189539 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:16.327803 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c34d0f63-e2fa-4c8b-87c8-588ab2189539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:16.335867 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 504/1002] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:16.695017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccb0ce-4547-4479-b821-07af8d8b567c None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:16.710637 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ccb0ce-4547-4479-b821-07af8d8b567c None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:16.716138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405fb6e-5fd2-4423-9319-08401b4ede7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:16.716757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405fb6e-5fd2-4423-9319-08401b4ede7d service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:16.717039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405fb6e-5fd2-4423-9319-08401b4ede7d service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:16.717435 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405fb6e-5fd2-4423-9319-08401b4ede7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:16.726424 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405fb6e-5fd2-4423-9319-08401b4ede7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:16.728089 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405fb6e-5fd2-4423-9319-08401b4ede7d service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:16.742658 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 499/1003] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:19.093512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe1ab7-5b7a-4036-838f-18e88eaddf04 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:19.094050 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe1ab7-5b7a-4036-838f-18e88eaddf04 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:19.094050 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe1ab7-5b7a-4036-838f-18e88eaddf04 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:19.095272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 505/1004] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:19.100486 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef619f-03fc-407e-b22b-508eae5fcb05 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:19.100882 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef619f-03fc-407e-b22b-508eae5fcb05 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:19.101030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef619f-03fc-407e-b22b-508eae5fcb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:19.121095 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-05ef619f-03fc-407e-b22b-508eae5fcb05 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:19.122304 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-05ef619f-03fc-407e-b22b-508eae5fcb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:19.130242 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 500/1005] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:19.478465 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe1ab7-5b7a-4036-838f-18e88eaddf04 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:19.495319 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe1ab7-5b7a-4036-838f-18e88eaddf04 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:19.500481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cc99e-c31b-4f4b-8e7a-76ebd0577c51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:19.501306 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc99e-c31b-4f4b-8e7a-76ebd0577c51 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:19.501720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc99e-c31b-4f4b-8e7a-76ebd0577c51 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:19.502090 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc99e-c31b-4f4b-8e7a-76ebd0577c51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:19.512005 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cc99e-c31b-4f4b-8e7a-76ebd0577c51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:19.513795 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cc99e-c31b-4f4b-8e7a-76ebd0577c51 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:19.524667 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 506/1006] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:21.776617 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18782-c053-4f36-8de0-b0f1a1cc5b50 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:21.777155 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18782-c053-4f36-8de0-b0f1a1cc5b50 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:21.777254 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18782-c053-4f36-8de0-b0f1a1cc5b50 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:21.779185 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 501/1007] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:21.784348 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5fec8-9e9a-4d0c-bda1-0e07bf4673f0 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:21.785024 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5fec8-9e9a-4d0c-bda1-0e07bf4673f0 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:21.785165 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5fec8-9e9a-4d0c-bda1-0e07bf4673f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:21.805897 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c4d5fec8-9e9a-4d0c-bda1-0e07bf4673f0 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:21.807132 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c4d5fec8-9e9a-4d0c-bda1-0e07bf4673f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:21.815163 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 507/1008] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:22.162829 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a18782-c053-4f36-8de0-b0f1a1cc5b50 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:22.180422 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a18782-c053-4f36-8de0-b0f1a1cc5b50 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:22.186712 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce9480-dd92-472f-abd0-db5fa6f1ef28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:22.187457 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9480-dd92-472f-abd0-db5fa6f1ef28 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:22.187818 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9480-dd92-472f-abd0-db5fa6f1ef28 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:22.188163 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9480-dd92-472f-abd0-db5fa6f1ef28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:22.199194 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce9480-dd92-472f-abd0-db5fa6f1ef28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:22.201272 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce9480-dd92-472f-abd0-db5fa6f1ef28 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:22.214169 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 502/1009] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:24.995270 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a8ad-8b3f-41e0-aa14-0c92492e0b4c None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:25.002102 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a8ad-8b3f-41e0-aa14-0c92492e0b4c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:25.002102 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a8ad-8b3f-41e0-aa14-0c92492e0b4c None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:25.002102 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 508/1010] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:25.002562 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b4e25-c417-4798-9d88-c25d8f6657f9 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:25.003064 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b4e25-c417-4798-9d88-c25d8f6657f9 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:25.003180 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b4e25-c417-4798-9d88-c25d8f6657f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:25.022941 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-6c5b4e25-c417-4798-9d88-c25d8f6657f9 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:25.025039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-6c5b4e25-c417-4798-9d88-c25d8f6657f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:25.032041 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 503/1011] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:25.656596 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a8ad-8b3f-41e0-aa14-0c92492e0b4c None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:25.671791 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a8ad-8b3f-41e0-aa14-0c92492e0b4c None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:25.676542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04027ecf-b288-44e1-93b3-aa37498e716f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:25.677131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04027ecf-b288-44e1-93b3-aa37498e716f service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:25.677404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04027ecf-b288-44e1-93b3-aa37498e716f service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:25.677698 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04027ecf-b288-44e1-93b3-aa37498e716f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:25.687014 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04027ecf-b288-44e1-93b3-aa37498e716f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:25.688628 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04027ecf-b288-44e1-93b3-aa37498e716f service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:25.698469 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 509/1012] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:28.441386 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c5cf-554c-4d40-9057-875fdcd156ba None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:28.441999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c5cf-554c-4d40-9057-875fdcd156ba None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:28.441999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21c5cf-554c-4d40-9057-875fdcd156ba None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:28.443286 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 504/1013] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:28.448743 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bf01-6196-456e-91e2-d5b99983e958 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:28.449220 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bf01-6196-456e-91e2-d5b99983e958 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:28.449309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325bf01-6196-456e-91e2-d5b99983e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:28.468519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-e325bf01-6196-456e-91e2-d5b99983e958 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:28.469995 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-e325bf01-6196-456e-91e2-d5b99983e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:28.479191 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 510/1014] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:28.828451 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21c5cf-554c-4d40-9057-875fdcd156ba None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:28.835848 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=46 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:59:28.843264 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21c5cf-554c-4d40-9057-875fdcd156ba None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:28.848499 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d4124-0f55-4a94-8051-ec1af274507c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:28.849099 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d4124-0f55-4a94-8051-ec1af274507c service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:28.849375 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d4124-0f55-4a94-8051-ec1af274507c service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:28.849677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d4124-0f55-4a94-8051-ec1af274507c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:28.862616 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d4124-0f55-4a94-8051-ec1af274507c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:28.864191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d4124-0f55-4a94-8051-ec1af274507c service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:28.874175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 505/1015] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:29.364303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83841cc3-d84d-4c9b-9354-b2acd20a5c8d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:29.364758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83841cc3-d84d-4c9b-9354-b2acd20a5c8d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:29.365037 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83841cc3-d84d-4c9b-9354-b2acd20a5c8d None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:29.366474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 511/1016] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:29.372912 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29b33-e388-4cc3-810c-a5906a187f05 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:29.373671 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29b33-e388-4cc3-810c-a5906a187f05 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:29.374196 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e29b33-e388-4cc3-810c-a5906a187f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:29.394691 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-75e29b33-e388-4cc3-810c-a5906a187f05 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:29.396235 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-75e29b33-e388-4cc3-810c-a5906a187f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:29.410005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 506/1017] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:29.771986 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d100a78-a7ae-46aa-b693-7d898d6f2910 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:29.772470 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d100a78-a7ae-46aa-b693-7d898d6f2910 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:29.772580 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d100a78-a7ae-46aa-b693-7d898d6f2910 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:29.774729 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 512/1018] 10.222.0.48 () {54 vars in 967 bytes} [Fri Aug 19 17:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:29.779759 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73a8a-f650-4166-84ac-d0c3f96ddf27 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:29.780212 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73a8a-f650-4166-84ac-d0c3f96ddf27 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:29.780317 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb73a8a-f650-4166-84ac-d0c3f96ddf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:29.829768 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-2fb73a8a-f650-4166-84ac-d0c3f96ddf27 None None] MFA Rules not processed for user `2d52483e48804cbfad701d198deea470`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:29.830953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-2fb73a8a-f650-4166-84ac-d0c3f96ddf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:29.893305 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 507/1019] 10.222.0.48 () {58 vars in 1064 bytes} [Fri Aug 19 17:59:29 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:29.901506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d100a78-a7ae-46aa-b693-7d898d6f2910 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:29.912444 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d100a78-a7ae-46aa-b693-7d898d6f2910 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:29.916247 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5f9bf-5b29-4980-9847-dea3d2afd4f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d52483e48804cbfad701d198deea470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:29.916852 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5f9bf-5b29-4980-9847-dea3d2afd4f8 service glance] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:29.917129 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5f9bf-5b29-4980-9847-dea3d2afd4f8 service glance] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:29.917545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5f9bf-5b29-4980-9847-dea3d2afd4f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:29.926765 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5f9bf-5b29-4980-9847-dea3d2afd4f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:29.928201 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5f9bf-5b29-4980-9847-dea3d2afd4f8 service glance] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:29.938143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 513/1020] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:31.264126 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ce2c-74cf-4dfd-9aa1-c792ff7a9f95 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:31.264810 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ce2c-74cf-4dfd-9aa1-c792ff7a9f95 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:31.264810 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ce2c-74cf-4dfd-9aa1-c792ff7a9f95 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:31.266034 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 508/1021] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:31.271471 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b20a1-ba07-43e7-8d63-3fa6f273539b None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:31.271957 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b20a1-ba07-43e7-8d63-3fa6f273539b None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:31.272065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b20a1-ba07-43e7-8d63-3fa6f273539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:31.291952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-a69b20a1-ba07-43e7-8d63-3fa6f273539b None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:31.293161 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-a69b20a1-ba07-43e7-8d63-3fa6f273539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:31.301013 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 514/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:31.667361 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39ce2c-74cf-4dfd-9aa1-c792ff7a9f95 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:31.678763 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b39ce2c-74cf-4dfd-9aa1-c792ff7a9f95 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:31.683886 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a002-64b8-41e2-9933-07184bddcdd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:31.684555 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a002-64b8-41e2-9933-07184bddcdd7 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:31.684917 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a002-64b8-41e2-9933-07184bddcdd7 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:31.685254 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a002-64b8-41e2-9933-07184bddcdd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:31.693982 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32a002-64b8-41e2-9933-07184bddcdd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:31.695745 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32a002-64b8-41e2-9933-07184bddcdd7 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:31.711915 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 509/1023] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:34.174654 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69107c4b-be21-4613-b1f2-e48206f7cc58 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:34.175332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69107c4b-be21-4613-b1f2-e48206f7cc58 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:34.175332 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69107c4b-be21-4613-b1f2-e48206f7cc58 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:34.176535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 515/1024] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 17:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:34.182693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950503-0936-4d8a-9f10-29f775c8c719 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:34.183185 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950503-0936-4d8a-9f10-29f775c8c719 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:34.183275 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3950503-0936-4d8a-9f10-29f775c8c719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:34.202522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-f3950503-0936-4d8a-9f10-29f775c8c719 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:34.203741 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-f3950503-0936-4d8a-9f10-29f775c8c719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:34.211691 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 510/1025] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 17:59:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:34.578567 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69107c4b-be21-4613-b1f2-e48206f7cc58 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:34.586724 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=92 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:59:34.594170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69107c4b-be21-4613-b1f2-e48206f7cc58 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:34.599140 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918ce7-8fdc-4f12-a890-dec670311a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:34.599748 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ce7-8fdc-4f12-a890-dec670311a89 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:34.600049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ce7-8fdc-4f12-a890-dec670311a89 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:34.600319 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ce7-8fdc-4f12-a890-dec670311a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:34.610786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918ce7-8fdc-4f12-a890-dec670311a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:34.612382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918ce7-8fdc-4f12-a890-dec670311a89 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:34.622567 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 516/1026] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:44.197581 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=55 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:59:44.704990 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=5 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 17:59:46.220331 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8612d5e-e668-457b-9821-fca319856b8c None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:46.220963 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8612d5e-e668-457b-9821-fca319856b8c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:46.220963 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8612d5e-e668-457b-9821-fca319856b8c None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:46.222254 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 511/1027] 10.222.0.48 () {54 vars in 918 bytes} [Fri Aug 19 17:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:46.228091 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54485b-1c0a-49ba-a351-7c3e04e5669c None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:46.228557 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54485b-1c0a-49ba-a351-7c3e04e5669c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:46.228659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54485b-1c0a-49ba-a351-7c3e04e5669c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:46.248935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-2a54485b-1c0a-49ba-a351-7c3e04e5669c None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:46.250178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-2a54485b-1c0a-49ba-a351-7c3e04e5669c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:46.258610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 517/1028] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Aug 19 17:59:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:46.272333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf1fc4-2000-403a-87d3-d05113e6a684 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:46.272618 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf1fc4-2000-403a-87d3-d05113e6a684 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:46.272895 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf1fc4-2000-403a-87d3-d05113e6a684 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:46.274231 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 512/1029] 10.222.0.48 () {54 vars in 918 bytes} [Fri Aug 19 17:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:46.278653 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1903-5780-4767-bf2c-ae84e07b49d3 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:46.278935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1903-5780-4767-bf2c-ae84e07b49d3 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:46.279207 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e1903-5780-4767-bf2c-ae84e07b49d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:46.310623 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-f35e1903-5780-4767-bf2c-ae84e07b49d3 None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:46.311800 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-f35e1903-5780-4767-bf2c-ae84e07b49d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:46.320085 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 518/1030] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Aug 19 17:59:46 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:49.069530 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793693e6-6368-4202-be50-f440d4fe5c0a None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:49.070138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793693e6-6368-4202-be50-f440d4fe5c0a None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:49.070138 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793693e6-6368-4202-be50-f440d4fe5c0a None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:49.071452 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 17:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:49.076950 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526e85-97f7-471f-a8fe-dca02f8bb9c0 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:49.077559 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526e85-97f7-471f-a8fe-dca02f8bb9c0 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:49.077703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17526e85-97f7-471f-a8fe-dca02f8bb9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:49.097966 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-17526e85-97f7-471f-a8fe-dca02f8bb9c0 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:49.099192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-17526e85-97f7-471f-a8fe-dca02f8bb9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:49.108045 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 17:59:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:49.489466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793693e6-6368-4202-be50-f440d4fe5c0a None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:49.506451 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793693e6-6368-4202-be50-f440d4fe5c0a None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:49.515003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229f526-e0b9-4fa6-a125-62dbdb497b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:49.515935 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f526-e0b9-4fa6-a125-62dbdb497b97 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:49.516388 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f526-e0b9-4fa6-a125-62dbdb497b97 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:49.516830 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229f526-e0b9-4fa6-a125-62dbdb497b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:49.529837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229f526-e0b9-4fa6-a125-62dbdb497b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:49.531584 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229f526-e0b9-4fa6-a125-62dbdb497b97 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:49.544304 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 514/1033] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:50.674517 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151827-8bb8-4e5f-88fd-721c1b1321e3 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:50.675049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151827-8bb8-4e5f-88fd-721c1b1321e3 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:50.675049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151827-8bb8-4e5f-88fd-721c1b1321e3 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:50.676344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:50.686298 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc04f-2d42-484a-b3b4-e40d768c022d None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:50.686745 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc04f-2d42-484a-b3b4-e40d768c022d None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:50.686840 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bc04f-2d42-484a-b3b4-e40d768c022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:50.708965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-c97bc04f-2d42-484a-b3b4-e40d768c022d None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:50.711518 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-c97bc04f-2d42-484a-b3b4-e40d768c022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:50.719563 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:59:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:50.922621 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151827-8bb8-4e5f-88fd-721c1b1321e3 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:50.943645 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151827-8bb8-4e5f-88fd-721c1b1321e3 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:50.951818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4593db-a8bf-451f-b46e-9abbb8199b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:50.952739 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4593db-a8bf-451f-b46e-9abbb8199b30 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:50.953189 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4593db-a8bf-451f-b46e-9abbb8199b30 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:50.953678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4593db-a8bf-451f-b46e-9abbb8199b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:50.963077 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4593db-a8bf-451f-b46e-9abbb8199b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:50.964698 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4593db-a8bf-451f-b46e-9abbb8199b30 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:50.974314 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 521/1036] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:51.922857 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63415-e919-4ca6-98e6-db0e7a8e8398 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:51.923827 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63415-e919-4ca6-98e6-db0e7a8e8398 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:51.923827 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e63415-e919-4ca6-98e6-db0e7a8e8398 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:51.924787 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:51.930771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d7d19-d730-4342-bfb7-6a112082027e None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:51.931210 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d7d19-d730-4342-bfb7-6a112082027e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:51.931341 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d7d19-d730-4342-bfb7-6a112082027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:51.951180 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-989d7d19-d730-4342-bfb7-6a112082027e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:51.952399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-989d7d19-d730-4342-bfb7-6a112082027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:51.960156 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:59:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:52.122526 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e63415-e919-4ca6-98e6-db0e7a8e8398 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:52.136525 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e63415-e919-4ca6-98e6-db0e7a8e8398 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:52.141436 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b46d7-c586-4483-9ef7-dff62c851af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:52.142043 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b46d7-c586-4483-9ef7-dff62c851af3 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:52.142314 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b46d7-c586-4483-9ef7-dff62c851af3 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:52.142587 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b46d7-c586-4483-9ef7-dff62c851af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:52.151622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b46d7-c586-4483-9ef7-dff62c851af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:52.153195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b46d7-c586-4483-9ef7-dff62c851af3 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:52.162889 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 517/1039] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 17:59:53.054647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25c53-7eb4-48e1-a7c6-6d441ff7b9b4 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:53.055447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25c53-7eb4-48e1-a7c6-6d441ff7b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:53.055447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25c53-7eb4-48e1-a7c6-6d441ff7b9b4 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:53.056716 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:53.061758 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e81a5-ef73-4777-bc54-428dda801889 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:53.062175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e81a5-ef73-4777-bc54-428dda801889 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:53.065492 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e81a5-ef73-4777-bc54-428dda801889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:53.082129 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-7d7e81a5-ef73-4777-bc54-428dda801889 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:53.083333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-7d7e81a5-ef73-4777-bc54-428dda801889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:53.091187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:59:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:53.248133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc25c53-7eb4-48e1-a7c6-6d441ff7b9b4 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:53.262086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc25c53-7eb4-48e1-a7c6-6d441ff7b9b4 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:53.266953 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca73de-9b81-4908-9fd4-15806a304f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:53.267548 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca73de-9b81-4908-9fd4-15806a304f14 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:53.267826 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca73de-9b81-4908-9fd4-15806a304f14 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:53.268098 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca73de-9b81-4908-9fd4-15806a304f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:53.276696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca73de-9b81-4908-9fd4-15806a304f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:53.278329 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca73de-9b81-4908-9fd4-15806a304f14 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:53.287949 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 524/1042] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:54.373728 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0de5-b835-49f7-890a-e8b188b36d29 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:54.374282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0de5-b835-49f7-890a-e8b188b36d29 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:54.374379 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0de5-b835-49f7-890a-e8b188b36d29 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:54.375986 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:54.381057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987dae-4a7d-49d1-adae-1e59bd7a070e None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:54.381488 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987dae-4a7d-49d1-adae-1e59bd7a070e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:54.381633 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987dae-4a7d-49d1-adae-1e59bd7a070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:54.404802 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-d5987dae-4a7d-49d1-adae-1e59bd7a070e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:54.406080 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-d5987dae-4a7d-49d1-adae-1e59bd7a070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:54.414428 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:59:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:54.585951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0de5-b835-49f7-890a-e8b188b36d29 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:54.608310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e0de5-b835-49f7-890a-e8b188b36d29 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:54.615581 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1981c92-0b64-4b8c-9032-883398139d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:54.616391 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1981c92-0b64-4b8c-9032-883398139d4a service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:54.617295 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1981c92-0b64-4b8c-9032-883398139d4a service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:54.617612 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1981c92-0b64-4b8c-9032-883398139d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:54.626045 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1981c92-0b64-4b8c-9032-883398139d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:54.627626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1981c92-0b64-4b8c-9032-883398139d4a service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:54.637037 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 520/1045] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:55.509719 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8be8-9417-411b-9f43-4b67a619aba2 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:55.512399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8be8-9417-411b-9f43-4b67a619aba2 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:55.512399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8be8-9417-411b-9f43-4b67a619aba2 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:55.512399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:55.516944 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b05d-9688-4208-858f-351a1be31e83 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:55.517390 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b05d-9688-4208-858f-351a1be31e83 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:55.517722 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b05d-9688-4208-858f-351a1be31e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:55.542625 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-6350b05d-9688-4208-858f-351a1be31e83 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:55.543958 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-6350b05d-9688-4208-858f-351a1be31e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:55.551815 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:59:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:55.760231 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8be8-9417-411b-9f43-4b67a619aba2 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:55.773487 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8be8-9417-411b-9f43-4b67a619aba2 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:55.778525 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df31867-0d9d-42e2-a911-b11d4e0ea81c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:55.779118 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31867-0d9d-42e2-a911-b11d4e0ea81c service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:55.779401 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31867-0d9d-42e2-a911-b11d4e0ea81c service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:55.779671 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df31867-0d9d-42e2-a911-b11d4e0ea81c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:55.787983 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df31867-0d9d-42e2-a911-b11d4e0ea81c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:55.790351 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df31867-0d9d-42e2-a911-b11d4e0ea81c service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:55.800019 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 527/1048] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:56.822801 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f0e2-0de2-4560-a7b5-be9cf458f5b0 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:56.823329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f0e2-0de2-4560-a7b5-be9cf458f5b0 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:56.823329 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603f0e2-0de2-4560-a7b5-be9cf458f5b0 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:56.824737 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:56.829693 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a2c9-435a-4915-864a-a9b6f2d5dc1c None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:56.830123 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a2c9-435a-4915-864a-a9b6f2d5dc1c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:56.830214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a2c9-435a-4915-864a-a9b6f2d5dc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:56.849012 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-3968a2c9-435a-4915-864a-a9b6f2d5dc1c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:56.850215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-3968a2c9-435a-4915-864a-a9b6f2d5dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:56.861182 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:59:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:57.030104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603f0e2-0de2-4560-a7b5-be9cf458f5b0 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:57.044153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603f0e2-0de2-4560-a7b5-be9cf458f5b0 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:57.049128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2bf4-2d80-4dbd-91ef-48c4ac9eed5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:57.049752 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2bf4-2d80-4dbd-91ef-48c4ac9eed5a service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:57.050033 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2bf4-2d80-4dbd-91ef-48c4ac9eed5a service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:57.050304 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2bf4-2d80-4dbd-91ef-48c4ac9eed5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:57.058999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2bf4-2d80-4dbd-91ef-48c4ac9eed5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:57.060587 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2bf4-2d80-4dbd-91ef-48c4ac9eed5a service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:57.070657 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 523/1051] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:58.097881 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428972c1-84e2-4251-a9cb-8e986a80bcc4 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:58.098445 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428972c1-84e2-4251-a9cb-8e986a80bcc4 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:58.098782 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428972c1-84e2-4251-a9cb-8e986a80bcc4 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:58.101779 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:59:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:58.106861 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81278-dd9c-4b2c-88cc-800dd56a5511 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:58.107266 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81278-dd9c-4b2c-88cc-800dd56a5511 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:58.107414 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81278-dd9c-4b2c-88cc-800dd56a5511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:58.129211 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-09e81278-dd9c-4b2c-88cc-800dd56a5511 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:58.130666 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-09e81278-dd9c-4b2c-88cc-800dd56a5511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:58.139400 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:59:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:58.301094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428972c1-84e2-4251-a9cb-8e986a80bcc4 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:58.315027 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428972c1-84e2-4251-a9cb-8e986a80bcc4 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:58.319891 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcb8c2-9666-4249-a22d-280347a8bd45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:58.320480 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcb8c2-9666-4249-a22d-280347a8bd45 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:58.320758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcb8c2-9666-4249-a22d-280347a8bd45 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:58.321027 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcb8c2-9666-4249-a22d-280347a8bd45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:58.329005 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcb8c2-9666-4249-a22d-280347a8bd45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:58.330718 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcb8c2-9666-4249-a22d-280347a8bd45 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:58.340447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 530/1054] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 17:59:59.224008 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5c55-a7d8-4873-b7f8-9874634331bd None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:59.224578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5c55-a7d8-4873-b7f8-9874634331bd None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:59.224578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5c55-a7d8-4873-b7f8-9874634331bd None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:59.226699 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 17:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 17:59:59.231612 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9175bb-338a-4bab-8e45-931fcef559f5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:59.232059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9175bb-338a-4bab-8e45-931fcef559f5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:59.232166 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9175bb-338a-4bab-8e45-931fcef559f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:59.250907 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-1d9175bb-338a-4bab-8e45-931fcef559f5 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 17:59:59.252075 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-1d9175bb-338a-4bab-8e45-931fcef559f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 17:59:59.260053 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 17:59:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 17:59:59.435202 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5c55-a7d8-4873-b7f8-9874634331bd None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 17:59:59.450766 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5c55-a7d8-4873-b7f8-9874634331bd None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 17:59:59.455785 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0dfc0a-86ed-4c24-9719-e786b73b3dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 17:59:59.456396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dfc0a-86ed-4c24-9719-e786b73b3dfc service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 17:59:59.456680 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dfc0a-86ed-4c24-9719-e786b73b3dfc service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 17:59:59.456958 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0dfc0a-86ed-4c24-9719-e786b73b3dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 17:59:59.465941 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dfc0a-86ed-4c24-9719-e786b73b3dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 17:59:59.467524 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0dfc0a-86ed-4c24-9719-e786b73b3dfc service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 17:59:59.477514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 526/1057] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 17:59:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:01.643051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aaaef-a701-4191-ada3-25305312e855 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:01.643580 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aaaef-a701-4191-ada3-25305312e855 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:01.643707 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aaaef-a701-4191-ada3-25305312e855 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:01.644978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:01.652134 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53be5c3-25e8-485f-a887-422560736fd7 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:01.652587 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53be5c3-25e8-485f-a887-422560736fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:01.653118 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53be5c3-25e8-485f-a887-422560736fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:01.674541 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d53be5c3-25e8-485f-a887-422560736fd7 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:01.675704 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d53be5c3-25e8-485f-a887-422560736fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:01.684629 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:02.042106 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aaaef-a701-4191-ada3-25305312e855 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:02.054918 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aaaef-a701-4191-ada3-25305312e855 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:02.058688 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040d698-2cfb-4dae-af5c-aa117b1136cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:02.059303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d698-2cfb-4dae-af5c-aa117b1136cd service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:02.059610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d698-2cfb-4dae-af5c-aa117b1136cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:02.059882 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d698-2cfb-4dae-af5c-aa117b1136cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:02.069838 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040d698-2cfb-4dae-af5c-aa117b1136cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:02.071414 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040d698-2cfb-4dae-af5c-aa117b1136cd service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:02.081723 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 533/1060] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:04.607202 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823d49e-94cb-424f-88cc-c22aec069188 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:04.608088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823d49e-94cb-424f-88cc-c22aec069188 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:04.608088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823d49e-94cb-424f-88cc-c22aec069188 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:04.610057 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 18:00:04.617269 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935be7e-2a2a-4bf0-8794-d2d334427515 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:04.617872 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935be7e-2a2a-4bf0-8794-d2d334427515 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:04.618209 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935be7e-2a2a-4bf0-8794-d2d334427515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:04.639405 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-4935be7e-2a2a-4bf0-8794-d2d334427515 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:04.640624 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-4935be7e-2a2a-4bf0-8794-d2d334427515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:04.648592 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:04.995377 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823d49e-94cb-424f-88cc-c22aec069188 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:05.007428 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823d49e-94cb-424f-88cc-c22aec069188 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:05.011216 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20fff6-0e4b-4146-9ed6-a34c52cd6c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:05.011834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20fff6-0e4b-4146-9ed6-a34c52cd6c2c service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:05.012116 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20fff6-0e4b-4146-9ed6-a34c52cd6c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:05.012385 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20fff6-0e4b-4146-9ed6-a34c52cd6c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:05.023561 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20fff6-0e4b-4146-9ed6-a34c52cd6c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:05.025043 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20fff6-0e4b-4146-9ed6-a34c52cd6c2c service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:05.036333 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 529/1063] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 18:00:07.814943 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58169a97-9240-4c46-98c9-3b8239d96c1c None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:07.815458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58169a97-9240-4c46-98c9-3b8239d96c1c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:07.815458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58169a97-9240-4c46-98c9-3b8239d96c1c None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:07.816774 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:07.822888 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12628d87-5fd2-48b5-bc9c-c8bd44677a53 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:07.827397 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12628d87-5fd2-48b5-bc9c-c8bd44677a53 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:07.827397 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12628d87-5fd2-48b5-bc9c-c8bd44677a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:07.843581 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-12628d87-5fd2-48b5-bc9c-c8bd44677a53 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:07.844793 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-12628d87-5fd2-48b5-bc9c-c8bd44677a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:07.853025 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:00:08.208302 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58169a97-9240-4c46-98c9-3b8239d96c1c None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:08.219278 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58169a97-9240-4c46-98c9-3b8239d96c1c None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:08.222736 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c4c17-5025-45f0-bdac-8c6f3bff6010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:08.223330 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c4c17-5025-45f0-bdac-8c6f3bff6010 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:08.223604 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c4c17-5025-45f0-bdac-8c6f3bff6010 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:08.223871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c4c17-5025-45f0-bdac-8c6f3bff6010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:08.233503 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c4c17-5025-45f0-bdac-8c6f3bff6010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:08.234927 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c4c17-5025-45f0-bdac-8c6f3bff6010 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:08.244688 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 536/1066] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:10.572352 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950d9a-47dc-4d89-8e07-5bffc3dc5041 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:10.572902 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950d9a-47dc-4d89-8e07-5bffc3dc5041 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:10.572902 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950d9a-47dc-4d89-8e07-5bffc3dc5041 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:10.574449 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:10.579548 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565ada-e8a8-4469-ab9f-e9b291b24c61 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:10.579946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565ada-e8a8-4469-ab9f-e9b291b24c61 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:10.580084 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565ada-e8a8-4469-ab9f-e9b291b24c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:10.599576 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-a9565ada-e8a8-4469-ab9f-e9b291b24c61 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:10.601375 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-a9565ada-e8a8-4469-ab9f-e9b291b24c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:10.609059 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:10.950692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950d9a-47dc-4d89-8e07-5bffc3dc5041 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:10.961974 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950d9a-47dc-4d89-8e07-5bffc3dc5041 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:10.965395 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b280ce-5dc3-467e-9d95-6e9cfa396e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:10.966083 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b280ce-5dc3-467e-9d95-6e9cfa396e0c service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:10.966361 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b280ce-5dc3-467e-9d95-6e9cfa396e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:10.966636 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b280ce-5dc3-467e-9d95-6e9cfa396e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:10.975631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b280ce-5dc3-467e-9d95-6e9cfa396e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:10.977040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b280ce-5dc3-467e-9d95-6e9cfa396e0c service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:10.986249 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 532/1069] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:13.326521 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783b458-67d3-43dd-8dc4-d1ca76b588ae None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:13.327064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783b458-67d3-43dd-8dc4-d1ca76b588ae None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:13.327064 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783b458-67d3-43dd-8dc4-d1ca76b588ae None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:13.328403 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:13.333824 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490efc8-fc45-4a80-bc99-7f5dba197057 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:13.334238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490efc8-fc45-4a80-bc99-7f5dba197057 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:13.334387 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490efc8-fc45-4a80-bc99-7f5dba197057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:13.353927 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-9490efc8-fc45-4a80-bc99-7f5dba197057 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:13.355334 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-9490efc8-fc45-4a80-bc99-7f5dba197057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:13.363187 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:13.706147 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783b458-67d3-43dd-8dc4-d1ca76b588ae None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:13.717391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783b458-67d3-43dd-8dc4-d1ca76b588ae None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:13.720783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8b1ec-33be-4f84-9e82-086a8d176c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:13.721370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b1ec-33be-4f84-9e82-086a8d176c3b service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:13.721747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b1ec-33be-4f84-9e82-086a8d176c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:13.722014 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8b1ec-33be-4f84-9e82-086a8d176c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:13.731466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8b1ec-33be-4f84-9e82-086a8d176c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:13.732878 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8b1ec-33be-4f84-9e82-086a8d176c3b service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:13.742209 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 539/1072] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:16.012177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113fa4-a07b-4c34-999c-a8b0363c6f1e None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:16.012885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113fa4-a07b-4c34-999c-a8b0363c6f1e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:16.012885 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71113fa4-a07b-4c34-999c-a8b0363c6f1e None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:16.014066 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:16.019260 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bedc59-6e7b-4f5e-aa89-77435b9cf53a None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:16.019738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bedc59-6e7b-4f5e-aa89-77435b9cf53a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:16.019841 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bedc59-6e7b-4f5e-aa89-77435b9cf53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:16.027542 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=75 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:00:16.040187 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-82bedc59-6e7b-4f5e-aa89-77435b9cf53a None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:16.044300 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-82bedc59-6e7b-4f5e-aa89-77435b9cf53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:16.049050 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:16.390177 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71113fa4-a07b-4c34-999c-a8b0363c6f1e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:16.395523 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=64 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:00:16.401747 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71113fa4-a07b-4c34-999c-a8b0363c6f1e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:16.405198 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce99803-ed53-4638-9794-6be1dc3638c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:16.405833 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce99803-ed53-4638-9794-6be1dc3638c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:16.418843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce99803-ed53-4638-9794-6be1dc3638c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:16.418843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce99803-ed53-4638-9794-6be1dc3638c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:16.418843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce99803-ed53-4638-9794-6be1dc3638c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:16.418843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce99803-ed53-4638-9794-6be1dc3638c8 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:16.427683 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 535/1075] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:18.889211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5150d0-a860-41c5-9f85-59f73016324a None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:18.889854 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5150d0-a860-41c5-9f85-59f73016324a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:18.889854 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5150d0-a860-41c5-9f85-59f73016324a None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:18.891123 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:18.897216 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286dc81-f4a7-497d-b9cf-8a26ec7eaadc None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:18.897829 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286dc81-f4a7-497d-b9cf-8a26ec7eaadc None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:18.898278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286dc81-f4a7-497d-b9cf-8a26ec7eaadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:18.922015 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-7286dc81-f4a7-497d-b9cf-8a26ec7eaadc None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:18.923252 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-7286dc81-f4a7-497d-b9cf-8a26ec7eaadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:18.936021 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:19.284133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5150d0-a860-41c5-9f85-59f73016324a None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:19.295853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5150d0-a860-41c5-9f85-59f73016324a None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:19.299675 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059162c3-9a96-4b06-af6e-577639b0476c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:19.300339 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059162c3-9a96-4b06-af6e-577639b0476c service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:19.300618 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059162c3-9a96-4b06-af6e-577639b0476c service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:19.300920 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059162c3-9a96-4b06-af6e-577639b0476c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:19.310736 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059162c3-9a96-4b06-af6e-577639b0476c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:19.312301 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059162c3-9a96-4b06-af6e-577639b0476c service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:19.321998 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 542/1078] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:21.582919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d19b4-53b1-4816-bd21-995762ce7b5b None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:21.583490 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d19b4-53b1-4816-bd21-995762ce7b5b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:21.583490 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d19b4-53b1-4816-bd21-995762ce7b5b None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:21.585065 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:21.591410 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498512d-d405-4a91-8ebd-9525a2aa5054 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:21.591856 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498512d-d405-4a91-8ebd-9525a2aa5054 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:21.591952 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498512d-d405-4a91-8ebd-9525a2aa5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:21.611607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-6498512d-d405-4a91-8ebd-9525a2aa5054 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:21.613073 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-6498512d-d405-4a91-8ebd-9525a2aa5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:21.621241 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:00:21.960792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d19b4-53b1-4816-bd21-995762ce7b5b None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:21.972432 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d19b4-53b1-4816-bd21-995762ce7b5b None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:21.976624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae971486-1018-40e0-8153-5c556fb17ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:21.977218 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971486-1018-40e0-8153-5c556fb17ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:21.977535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971486-1018-40e0-8153-5c556fb17ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:21.977810 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae971486-1018-40e0-8153-5c556fb17ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:21.986729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971486-1018-40e0-8153-5c556fb17ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:21.988156 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae971486-1018-40e0-8153-5c556fb17ea5 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:21.997616 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 538/1081] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:24.241521 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f6082-157f-4701-8d24-122ea25f0614 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:24.242122 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f6082-157f-4701-8d24-122ea25f0614 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:24.242122 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f6082-157f-4701-8d24-122ea25f0614 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:24.243447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:24.249039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1165b4-f5fa-4191-a9b0-718662ed8d9e None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:24.249519 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1165b4-f5fa-4191-a9b0-718662ed8d9e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:24.249626 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1165b4-f5fa-4191-a9b0-718662ed8d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:24.269358 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-ff1165b4-f5fa-4191-a9b0-718662ed8d9e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:24.270603 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-ff1165b4-f5fa-4191-a9b0-718662ed8d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:24.279115 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:24.629539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f6082-157f-4701-8d24-122ea25f0614 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:24.646361 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f6082-157f-4701-8d24-122ea25f0614 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:24.652416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9053370-ba57-4deb-b411-5bd849ff2db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:24.653339 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053370-ba57-4deb-b411-5bd849ff2db3 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:24.653779 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053370-ba57-4deb-b411-5bd849ff2db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:24.654178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053370-ba57-4deb-b411-5bd849ff2db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:24.670366 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9053370-ba57-4deb-b411-5bd849ff2db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:24.672292 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9053370-ba57-4deb-b411-5bd849ff2db3 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:24.685208 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 545/1084] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:26.925435 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037d5a-cf30-414e-9f81-febaa03a15c6 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:26.925995 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037d5a-cf30-414e-9f81-febaa03a15c6 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:26.926125 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037d5a-cf30-414e-9f81-febaa03a15c6 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:26.927359 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:26.933194 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d68c-a478-42f9-9e97-ef6d2e803309 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:26.933741 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d68c-a478-42f9-9e97-ef6d2e803309 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:26.933851 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d68c-a478-42f9-9e97-ef6d2e803309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:26.952896 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-72d0d68c-a478-42f9-9e97-ef6d2e803309 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:26.954243 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-72d0d68c-a478-42f9-9e97-ef6d2e803309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:26.962566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:00:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:27.321389 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd037d5a-cf30-414e-9f81-febaa03a15c6 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:27.332127 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd037d5a-cf30-414e-9f81-febaa03a15c6 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:27.336531 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b927d-e832-4a51-b3dc-6b080bb2d2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:27.337126 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b927d-e832-4a51-b3dc-6b080bb2d2ae service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:27.337396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b927d-e832-4a51-b3dc-6b080bb2d2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:27.337687 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b927d-e832-4a51-b3dc-6b080bb2d2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:27.346475 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b927d-e832-4a51-b3dc-6b080bb2d2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:27.347888 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b927d-e832-4a51-b3dc-6b080bb2d2ae service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:27.357633 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 541/1087] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:36.948048 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=20 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:00:37.353531 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=23 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:00:52.707544 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedffee-89a7-4c49-8998-63ecf419e43a None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:52.708112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedffee-89a7-4c49-8998-63ecf419e43a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:52.708112 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedffee-89a7-4c49-8998-63ecf419e43a None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:52.709935 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 547/1088] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 18:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:52.715092 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98a48-779a-4da8-9c02-da5c35ae728c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:52.715543 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98a48-779a-4da8-9c02-da5c35ae728c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:52.715653 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b98a48-779a-4da8-9c02-da5c35ae728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:52.735030 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-b5b98a48-779a-4da8-9c02-da5c35ae728c None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:52.736215 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-b5b98a48-779a-4da8-9c02-da5c35ae728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:52.743932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 542/1089] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 18:00:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:53.101464 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aadaf-ea0a-4667-b86a-92bc5fceeedd None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:53.102705 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aadaf-ea0a-4667-b86a-92bc5fceeedd None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:53.102705 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315aadaf-ea0a-4667-b86a-92bc5fceeedd None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:53.103494 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 548/1090] 10.222.0.48 () {54 vars in 967 bytes} [Fri Aug 19 18:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 18:00:53.108684 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aa60c-aaec-4168-80c0-41db5346ed33 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:53.108989 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aa60c-aaec-4168-80c0-41db5346ed33 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:53.109260 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165aa60c-aaec-4168-80c0-41db5346ed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:53.129535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-165aa60c-aaec-4168-80c0-41db5346ed33 None None] MFA Rules not processed for user `2d52483e48804cbfad701d198deea470`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:53.130813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-165aa60c-aaec-4168-80c0-41db5346ed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:53.137494 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 543/1091] 10.222.0.48 () {58 vars in 1064 bytes} [Fri Aug 19 18:00:53 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:53.144529 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aadaf-ea0a-4667-b86a-92bc5fceeedd None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:53.155600 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315aadaf-ea0a-4667-b86a-92bc5fceeedd None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:53.159400 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96863dac-eece-4276-8b38-ee175a306bd2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d52483e48804cbfad701d198deea470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:53.159997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863dac-eece-4276-8b38-ee175a306bd2 service glance] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:53.160272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863dac-eece-4276-8b38-ee175a306bd2 service glance] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:53.160541 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96863dac-eece-4276-8b38-ee175a306bd2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:53.170171 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96863dac-eece-4276-8b38-ee175a306bd2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:53.171609 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96863dac-eece-4276-8b38-ee175a306bd2 service glance] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:53.182124 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 549/1092] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:00:55.441142 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed89e7-ba14-4dd1-9a88-6822caefb497 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:55.441821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed89e7-ba14-4dd1-9a88-6822caefb497 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:55.441821 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed89e7-ba14-4dd1-9a88-6822caefb497 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:55.443111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 544/1093] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 18:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:55.448474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b2ba-3073-4dde-bb09-da99329cf74e None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:55.448868 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b2ba-3073-4dde-bb09-da99329cf74e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:55.449024 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b2ba-3073-4dde-bb09-da99329cf74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:55.469133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-5001b2ba-3073-4dde-bb09-da99329cf74e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:55.470371 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-5001b2ba-3073-4dde-bb09-da99329cf74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:55.478679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 550/1094] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 18:00:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:55.813988 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed89e7-ba14-4dd1-9a88-6822caefb497 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:55.827528 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed89e7-ba14-4dd1-9a88-6822caefb497 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:55.832029 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b2e7f-9dbd-402d-b05c-1ce93d5c0d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:55.832622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2e7f-9dbd-402d-b05c-1ce93d5c0d10 admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:55.832900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2e7f-9dbd-402d-b05c-1ce93d5c0d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:55.833168 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b2e7f-9dbd-402d-b05c-1ce93d5c0d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:55.834418 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b2e7f-9dbd-402d-b05c-1ce93d5c0d10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:55.836147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING py.warnings [None req-208b2e7f-9dbd-402d-b05c-1ce93d5c0d10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:00:55.836147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: warnings.warn(msg) Aug 19 18:00:55.836147 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: Aug 19 18:00:55.837285 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b2e7f-9dbd-402d-b05c-1ce93d5c0d10 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:55.854890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 545/1095] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Aug 19 18:00:55 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 18:00:58.056689 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015816c-a3a4-4360-91aa-d1c4f6822c40 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:58.057257 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015816c-a3a4-4360-91aa-d1c4f6822c40 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:58.057257 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015816c-a3a4-4360-91aa-d1c4f6822c40 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:58.058569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 551/1096] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 18:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:00:58.063631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a28c-ae33-4996-aed3-f871a269d646 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:58.064071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a28c-ae33-4996-aed3-f871a269d646 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:58.064165 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05a28c-ae33-4996-aed3-f871a269d646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:58.085353 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-cc05a28c-ae33-4996-aed3-f871a269d646 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:00:58.086558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-cc05a28c-ae33-4996-aed3-f871a269d646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:00:58.094203 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 546/1097] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 18:00:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:00:58.442552 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015816c-a3a4-4360-91aa-d1c4f6822c40 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:00:58.455973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015816c-a3a4-4360-91aa-d1c4f6822c40 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:00:58.461666 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5f8d8-4e4b-4098-a742-f528d10f0a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:00:58.462473 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5f8d8-4e4b-4098-a742-f528d10f0a04 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:00:58.462578 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5f8d8-4e4b-4098-a742-f528d10f0a04 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:00:58.462771 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5f8d8-4e4b-4098-a742-f528d10f0a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:00:58.470887 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5f8d8-4e4b-4098-a742-f528d10f0a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:00:58.472490 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5f8d8-4e4b-4098-a742-f528d10f0a04 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:00:58.482654 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 552/1098] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:00:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:01:00.855200 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b62d9-7150-4876-9941-0930448c41d6 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:00.855729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b62d9-7150-4876-9941-0930448c41d6 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:00.855729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b62d9-7150-4876-9941-0930448c41d6 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:00.856984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 547/1099] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 18:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:01:00.862203 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b7245-b4d0-4b41-aff0-614697b573a5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:00.862606 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b7245-b4d0-4b41-aff0-614697b573a5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:00.862746 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b7245-b4d0-4b41-aff0-614697b573a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:00.881810 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-134b7245-b4d0-4b41-aff0-614697b573a5 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:01:00.883000 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-134b7245-b4d0-4b41-aff0-614697b573a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:01:00.890551 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 553/1100] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 18:01:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:01:01.241987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b62d9-7150-4876-9941-0930448c41d6 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:01:01.252517 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b62d9-7150-4876-9941-0930448c41d6 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:01:01.256161 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd88bc-b54a-4fd3-9815-53548ad732e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:01:01.256748 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd88bc-b54a-4fd3-9815-53548ad732e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:01.257023 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd88bc-b54a-4fd3-9815-53548ad732e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:01.257293 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd88bc-b54a-4fd3-9815-53548ad732e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:01.265976 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd88bc-b54a-4fd3-9815-53548ad732e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:01:01.267389 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd88bc-b54a-4fd3-9815-53548ad732e1 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:01:01.277054 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 548/1101] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:01:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:01:03.518199 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec78b-1051-4bc7-802e-14adba21bf51 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:03.518818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec78b-1051-4bc7-802e-14adba21bf51 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:03.518818 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec78b-1051-4bc7-802e-14adba21bf51 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:03.520046 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 554/1102] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 18:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:01:03.526087 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697dea-9e5d-4291-8fac-44ed4418b39e None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:03.526533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697dea-9e5d-4291-8fac-44ed4418b39e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:03.526642 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b697dea-9e5d-4291-8fac-44ed4418b39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:03.546696 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-2b697dea-9e5d-4291-8fac-44ed4418b39e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:01:03.547951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-2b697dea-9e5d-4291-8fac-44ed4418b39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:01:03.556104 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 549/1103] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 18:01:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:01:03.915259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fec78b-1051-4bc7-802e-14adba21bf51 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:01:03.925798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fec78b-1051-4bc7-802e-14adba21bf51 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:01:03.929863 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85024a78-5170-44ec-adef-f534b4b57bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:01:03.930670 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85024a78-5170-44ec-adef-f534b4b57bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:03.931155 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85024a78-5170-44ec-adef-f534b4b57bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:03.931506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85024a78-5170-44ec-adef-f534b4b57bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:03.940616 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85024a78-5170-44ec-adef-f534b4b57bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:01:03.942073 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85024a78-5170-44ec-adef-f534b4b57bb3 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:01:03.952229 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 555/1104] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:01:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 18:01:06.249041 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f630b80-ed23-481d-a8eb-252618ed5437 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:06.249606 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f630b80-ed23-481d-a8eb-252618ed5437 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:06.249606 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f630b80-ed23-481d-a8eb-252618ed5437 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:06.250916 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 550/1105] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 18:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:01:06.256598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86569b0-292f-4d6b-9671-5c5828662db7 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:06.257027 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86569b0-292f-4d6b-9671-5c5828662db7 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:06.257141 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86569b0-292f-4d6b-9671-5c5828662db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:06.276391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c86569b0-292f-4d6b-9671-5c5828662db7 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:01:06.277629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c86569b0-292f-4d6b-9671-5c5828662db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:01:06.285697 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 556/1106] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 18:01:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:01:06.651398 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f630b80-ed23-481d-a8eb-252618ed5437 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:01:06.664242 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f630b80-ed23-481d-a8eb-252618ed5437 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:01:06.667645 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd92c6b-8a01-4eb5-803e-67f96c9bca8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:01:06.668218 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd92c6b-8a01-4eb5-803e-67f96c9bca8f service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:06.668491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd92c6b-8a01-4eb5-803e-67f96c9bca8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:06.668757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd92c6b-8a01-4eb5-803e-67f96c9bca8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:06.678129 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd92c6b-8a01-4eb5-803e-67f96c9bca8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:01:06.679555 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd92c6b-8a01-4eb5-803e-67f96c9bca8f service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:01:06.688968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 551/1107] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:01:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:01:09.289809 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f38e3-0744-48c3-9136-dc633c593e96 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:09.290398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f38e3-0744-48c3-9136-dc633c593e96 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:09.290398 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f38e3-0744-48c3-9136-dc633c593e96 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:09.291677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 557/1108] 10.222.0.48 () {54 vars in 927 bytes} [Fri Aug 19 18:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:01:09.296729 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8447f-59b0-4c96-8d0e-fa860e8769a7 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:09.297117 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8447f-59b0-4c96-8d0e-fa860e8769a7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:09.297283 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8447f-59b0-4c96-8d0e-fa860e8769a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:09.316305 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-c7c8447f-59b0-4c96-8d0e-fa860e8769a7 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:01:09.318111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-c7c8447f-59b0-4c96-8d0e-fa860e8769a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:01:09.327539 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 552/1109] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Aug 19 18:01:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:01:09.673017 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f38e3-0744-48c3-9136-dc633c593e96 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:01:09.684214 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f38e3-0744-48c3-9136-dc633c593e96 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:01:09.687825 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a39b-4d1d-458c-b3d1-391796dcc01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:01:09.688425 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a39b-4d1d-458c-b3d1-391796dcc01d service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:01:09.688704 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a39b-4d1d-458c-b3d1-391796dcc01d service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:01:09.688976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a39b-4d1d-458c-b3d1-391796dcc01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:01:09.698665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a39b-4d1d-458c-b3d1-391796dcc01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:01:09.700091 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a39b-4d1d-458c-b3d1-391796dcc01d service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:01:09.709428 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 558/1110] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:01:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 18:01:19.311613 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=33 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:01:19.705282 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=33 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:02:34.223465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e05f-46ef-4609-aef1-43d04cc81bb3 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.224111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e05f-46ef-4609-aef1-43d04cc81bb3 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.224111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e05f-46ef-4609-aef1-43d04cc81bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.242985 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-9174e05f-46ef-4609-aef1-43d04cc81bb3 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:02:34.244195 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-9174e05f-46ef-4609-aef1-43d04cc81bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:02:34.251857 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 553/1111] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:02:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:02:34.260404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30be8-ac30-4ec2-8557-6704ad9f860a None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.261049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30be8-ac30-4ec2-8557-6704ad9f860a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.261049 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a30be8-ac30-4ec2-8557-6704ad9f860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.280527 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-96a30be8-ac30-4ec2-8557-6704ad9f860a None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:02:34.281807 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-96a30be8-ac30-4ec2-8557-6704ad9f860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:02:34.289626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 559/1112] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:02:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:02:34.294119 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174e05f-46ef-4609-aef1-43d04cc81bb3 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:34.304292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174e05f-46ef-4609-aef1-43d04cc81bb3 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:34.308867 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:34.309491 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.309774 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.310049 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.310688 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 18:02:34.310991 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:34.311993 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING py.warnings [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:02:34.311993 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: warnings.warn(msg) Aug 19 18:02:34.311993 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: Aug 19 18:02:34.312887 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:34.325161 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 554/1113] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Aug 19 18:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 18:02:34.333234 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30be8-ac30-4ec2-8557-6704ad9f860a None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:34.342731 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a30be8-ac30-4ec2-8557-6704ad9f860a None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:34.347388 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:34.355196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.355196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.355196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.355196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:34.355196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING py.warnings [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:02:34.355196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: warnings.warn(msg) Aug 19 18:02:34.355196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: Aug 19 18:02:34.355819 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:34.483968 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 560/1114] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Aug 19 18:02:34 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 18:02:34.488341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:34.499186 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098dfae6-18d9-4f5a-b045-ea131b95edb1 admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:34.556224 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:34.556834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.557114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.557385 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.558046 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:34.559050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING py.warnings [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:02:34.559050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: warnings.warn(msg) Aug 19 18:02:34.559050 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: Aug 19 18:02:34.560250 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:34.667792 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 555/1115] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 18:02:34 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 18:02:34.671992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:34.683057 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c18cf-f954-4671-bd74-a636fc493753 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:34.687562 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:34.688190 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.688465 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.688735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.689367 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:34.690399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING py.warnings [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:02:34.690399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: warnings.warn(msg) Aug 19 18:02:34.690399 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: Aug 19 18:02:34.691284 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:34.703906 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 561/1116] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 18:02:34.707747 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:34.718484 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fa4f3-4a82-4379-be00-5506234c0378 admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:34.722662 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f95217-64bd-4033-b7a0-2249d90914fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:34.729813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95217-64bd-4033-b7a0-2249d90914fa admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.729813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95217-64bd-4033-b7a0-2249d90914fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.729813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95217-64bd-4033-b7a0-2249d90914fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.729813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95217-64bd-4033-b7a0-2249d90914fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:34.729813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING py.warnings [None req-63f95217-64bd-4033-b7a0-2249d90914fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:02:34.729813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: warnings.warn(msg) Aug 19 18:02:34.729813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: Aug 19 18:02:34.730453 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95217-64bd-4033-b7a0-2249d90914fa admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:34.741577 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 556/1117] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 18:02:34.745750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:34.755641 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d050087-bdfb-41bc-821c-98893038d505 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:34.760447 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc7d08-d8c8-41ba-a815-1e8e13e14959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:34.761138 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7d08-d8c8-41ba-a815-1e8e13e14959 admin admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.761476 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7d08-d8c8-41ba-a815-1e8e13e14959 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.761783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc7d08-d8c8-41ba-a815-1e8e13e14959 admin admin] PATH_INFO: `/v3/projects/7b852295b3a14521a35caf8fa59c726e/users/e84ab735a0134505a5393e940767c915/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.776343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc7d08-d8c8-41ba-a815-1e8e13e14959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b852295b3a14521a35caf8fa59c726e, user_id=e84ab735a0134505a5393e940767c915, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:34.777374 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING py.warnings [None req-b5bc7d08-d8c8-41ba-a815-1e8e13e14959 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:02:34.777374 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: warnings.warn(msg) Aug 19 18:02:34.777374 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: Aug 19 18:02:34.779331 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc7d08-d8c8-41ba-a815-1e8e13e14959 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:34.861002 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 562/1118] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Aug 19 18:02:34 2022] PUT /identity/v3/projects/7b852295b3a14521a35caf8fa59c726e/users/e84ab735a0134505a5393e940767c915/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:02:34.873936 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6aac9-df4c-42bc-b0c3-7985b7426c81 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.874222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6aac9-df4c-42bc-b0c3-7985b7426c81 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.874495 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6aac9-df4c-42bc-b0c3-7985b7426c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.901829 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e6c6aac9-df4c-42bc-b0c3-7985b7426c81 None None] MFA Rules not processed for user `e84ab735a0134505a5393e940767c915`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:02:34.910513 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e6c6aac9-df4c-42bc-b0c3-7985b7426c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:02:34.967129 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 557/1119] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:02:34 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:02:34.980923 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552338e-e149-4836-8941-c9044b386f9d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.981210 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552338e-e149-4836-8941-c9044b386f9d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.981519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552338e-e149-4836-8941-c9044b386f9d None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:34.982870 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 563/1120] 10.222.0.48 () {54 vars in 964 bytes} [Fri Aug 19 18:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:02:34.987616 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85b32-5dcf-427e-a7f6-e2077abcef57 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:34.987901 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85b32-5dcf-427e-a7f6-e2077abcef57 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:34.988175 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85b32-5dcf-427e-a7f6-e2077abcef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:35.018604 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-4ed85b32-5dcf-427e-a7f6-e2077abcef57 None None] MFA Rules not processed for user `7fb05df536de4b159101ffa5cc41c5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:02:35.019722 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-4ed85b32-5dcf-427e-a7f6-e2077abcef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:02:35.051867 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:02:35.069403 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 558/1121] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Aug 19 18:02:34 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:02:35.077054 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552338e-e149-4836-8941-c9044b386f9d None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:35.089632 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552338e-e149-4836-8941-c9044b386f9d None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:35.093678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b007a-80dc-4555-9364-6c3de72971c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb05df536de4b159101ffa5cc41c5ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:35.093678 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b007a-80dc-4555-9364-6c3de72971c9 service cinder] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:35.093962 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b007a-80dc-4555-9364-6c3de72971c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:35.094196 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b007a-80dc-4555-9364-6c3de72971c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:35.103063 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b007a-80dc-4555-9364-6c3de72971c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:35.104485 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b007a-80dc-4555-9364-6c3de72971c9 service cinder] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:35.113082 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 564/1122] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:02:35 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:02:35.151242 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379fbd4-2769-4b36-b6d1-727beeb5d8c3 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:35.151529 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379fbd4-2769-4b36-b6d1-727beeb5d8c3 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:35.156924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379fbd4-2769-4b36-b6d1-727beeb5d8c3 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:35.156924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 559/1123] 10.222.0.48 () {52 vars in 830 bytes} [Fri Aug 19 18:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:02:35.157149 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b007a-80dc-4555-9364-6c3de72971c9 service cinder] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:35.219238 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b007a-80dc-4555-9364-6c3de72971c9 service cinder] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:35.224585 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:35.225234 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:35.225569 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:35.225880 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] PATH_INFO: `/v3/users/e84ab735a0134505a5393e940767c915` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:35.227017 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84ab735a0134505a5393e940767c915)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:35.228018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING py.warnings [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:02:35.228018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: warnings.warn(msg) Aug 19 18:02:35.228018 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: Aug 19 18:02:35.229215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:35.436738 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84ab735a0134505a5393e940767c915'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:35.506855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84ab735a0134505a5393e940767c915'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:35.530905 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84ab735a0134505a5393e940767c915'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:35.541595 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:02:35.545942 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84ab735a0134505a5393e940767c915'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:35.546731 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84ab735a0134505a5393e940767c915'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:35.553271 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 565/1124] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Aug 19 18:02:35 2022] DELETE /identity/v3/users/e84ab735a0134505a5393e940767c915 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:02:35.557682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9003196-8e33-468f-9753-04a1f9166b02 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:35.558132 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9003196-8e33-468f-9753-04a1f9166b02 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:35.558258 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9003196-8e33-468f-9753-04a1f9166b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:35.577274 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e9003196-8e33-468f-9753-04a1f9166b02 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:02:35.578494 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e9003196-8e33-468f-9753-04a1f9166b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:02:35.637039 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 560/1125] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:02:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:02:35.646763 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:35.648172 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:02:35.718460 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af7b78-570b-47e0-a240-a0420e327da8 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:35.721893 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68cb6-3e3b-4e81-b943-13f1383ade27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:35.722502 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68cb6-3e3b-4e81-b943-13f1383ade27 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:35.722780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68cb6-3e3b-4e81-b943-13f1383ade27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:35.723052 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68cb6-3e3b-4e81-b943-13f1383ade27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:35.732582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68cb6-3e3b-4e81-b943-13f1383ade27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:35.734066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68cb6-3e3b-4e81-b943-13f1383ade27 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:35.745871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 566/1126] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:02:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:02:36.222919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9003196-8e33-468f-9753-04a1f9166b02 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:02:36.222919 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e9003196-8e33-468f-9753-04a1f9166b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:02:36.235311 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9003196-8e33-468f-9753-04a1f9166b02 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:02:36.241724 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:02:36.242396 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:02:36.242672 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:02:36.242941 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] PATH_INFO: `/v3/projects/7b852295b3a14521a35caf8fa59c726e` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:02:36.244100 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b852295b3a14521a35caf8fa59c726e)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:02:36.245128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING py.warnings [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:02:36.245128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: warnings.warn(msg) Aug 19 18:02:36.245128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: Aug 19 18:02:36.247190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:02:36.397918 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b852295b3a14521a35caf8fa59c726e', 'request_id': 'req-a62719b3-eb9a-4b6b-b141-e58156896b84'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:36.482208 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b852295b3a14521a35caf8fa59c726e', 'request_id': 'req-a62719b3-eb9a-4b6b-b141-e58156896b84'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:36.492584 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b852295b3a14521a35caf8fa59c726e', 'request_id': 'req-a62719b3-eb9a-4b6b-b141-e58156896b84'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:36.508548 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] The token cache is being invalidate because project 7b852295b3a14521a35caf8fa59c726e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 18:02:36.508843 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:36.509556 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-a62719b3-eb9a-4b6b-b141-e58156896b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:02:36.511154 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 561/1127] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Aug 19 18:02:36 2022] DELETE /identity/v3/projects/7b852295b3a14521a35caf8fa59c726e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:02:45.741686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=34 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:02:46.505563 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:03:59.204307 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678bab-0789-4b2f-88df-055298d1f399 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:03:59.204904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678bab-0789-4b2f-88df-055298d1f399 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:03:59.204904 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678bab-0789-4b2f-88df-055298d1f399 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:03:59.206250 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 18:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:03:59.211171 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4324d0f-498f-487e-a8f2-d59a63924394 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:03:59.211607 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4324d0f-498f-487e-a8f2-d59a63924394 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:03:59.211710 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4324d0f-498f-487e-a8f2-d59a63924394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:03:59.231330 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-a4324d0f-498f-487e-a8f2-d59a63924394 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:03:59.232527 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-a4324d0f-498f-487e-a8f2-d59a63924394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:03:59.290289 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 18:03:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:03:59.446005 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77678bab-0789-4b2f-88df-055298d1f399 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:03:59.447714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-77678bab-0789-4b2f-88df-055298d1f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:03:59.519051 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77678bab-0789-4b2f-88df-055298d1f399 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:03:59.524414 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ce7fe-e0c3-48dc-9cb1-b386f1f13bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:03:59.525027 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ce7fe-e0c3-48dc-9cb1-b386f1f13bc8 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:03:59.525309 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ce7fe-e0c3-48dc-9cb1-b386f1f13bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:03:59.525615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ce7fe-e0c3-48dc-9cb1-b386f1f13bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:03:59.534003 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ce7fe-e0c3-48dc-9cb1-b386f1f13bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:03:59.535579 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ce7fe-e0c3-48dc-9cb1-b386f1f13bc8 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:03:59.544946 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 568/1130] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:03:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:00.385811 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876a874-f71e-4bd4-95b7-5d953e38ab15 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:00.386378 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876a874-f71e-4bd4-95b7-5d953e38ab15 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:00.386378 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876a874-f71e-4bd4-95b7-5d953e38ab15 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:00.387672 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 18:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:00.392402 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ee22-8050-4fc3-8e16-2d7a3bc1eb9e None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:00.392792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ee22-8050-4fc3-8e16-2d7a3bc1eb9e None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:00.392954 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47ee22-8050-4fc3-8e16-2d7a3bc1eb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:00.413230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-fb47ee22-8050-4fc3-8e16-2d7a3bc1eb9e None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:00.414449 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-fb47ee22-8050-4fc3-8e16-2d7a3bc1eb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:00.422137 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 18:04:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:00.580304 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876a874-f71e-4bd4-95b7-5d953e38ab15 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:00.594951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876a874-f71e-4bd4-95b7-5d953e38ab15 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:00.599925 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019d198-438e-4d52-8980-94d14d384144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:00.600522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d198-438e-4d52-8980-94d14d384144 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:00.600804 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d198-438e-4d52-8980-94d14d384144 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:00.601080 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019d198-438e-4d52-8980-94d14d384144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:00.609084 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019d198-438e-4d52-8980-94d14d384144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:00.610712 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019d198-438e-4d52-8980-94d14d384144 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:00.620152 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 564/1133] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:05.136365 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390153-842f-4b44-a45f-616b686f411d None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:05.136908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390153-842f-4b44-a45f-616b686f411d None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:05.136908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390153-842f-4b44-a45f-616b686f411d None None] PATH_INFO: `/v3` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:05.138238 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 570/1134] 10.222.0.17 () {54 vars in 925 bytes} [Fri Aug 19 18:04:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 19 18:04:05.144111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0313738-1c69-41e6-a239-4f319f56ec60 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:05.144511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0313738-1c69-41e6-a239-4f319f56ec60 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:05.144670 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0313738-1c69-41e6-a239-4f319f56ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:05.175852 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-b0313738-1c69-41e6-a239-4f319f56ec60 None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:05.177040 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-b0313738-1c69-41e6-a239-4f319f56ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:05.237864 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 565/1135] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 19 18:04:05 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:10.407484 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=35 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:04:11.854489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311188d-73c3-40cf-b8dc-1de89e87c0b3 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:11.855150 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311188d-73c3-40cf-b8dc-1de89e87c0b3 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:11.855150 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311188d-73c3-40cf-b8dc-1de89e87c0b3 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:11.856272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 571/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 18:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:11.860964 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14d74-c37c-4d99-bd35-1d889ded1bf8 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:11.861447 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14d74-c37c-4d99-bd35-1d889ded1bf8 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:11.861565 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c14d74-c37c-4d99-bd35-1d889ded1bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:11.881587 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-65c14d74-c37c-4d99-bd35-1d889ded1bf8 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:11.882817 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-65c14d74-c37c-4d99-bd35-1d889ded1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:11.890588 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 566/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 18:04:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:12.052120 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311188d-73c3-40cf-b8dc-1de89e87c0b3 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:12.065900 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311188d-73c3-40cf-b8dc-1de89e87c0b3 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:12.071673 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe7e90-7220-4377-9fc8-d3d1fa053896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:12.072264 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7e90-7220-4377-9fc8-d3d1fa053896 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:12.072540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7e90-7220-4377-9fc8-d3d1fa053896 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:12.072811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe7e90-7220-4377-9fc8-d3d1fa053896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:12.080914 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe7e90-7220-4377-9fc8-d3d1fa053896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:12.082520 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe7e90-7220-4377-9fc8-d3d1fa053896 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:12.092048 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 572/1138] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:12.919225 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313530e-610d-4adf-a3f2-4565a641400b None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:12.919779 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313530e-610d-4adf-a3f2-4565a641400b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:12.919779 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313530e-610d-4adf-a3f2-4565a641400b None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:12.921278 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 18:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:12.925981 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a977-9fa0-4ed6-9f97-0e88a9a4461f None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:12.926404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a977-9fa0-4ed6-9f97-0e88a9a4461f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:12.926521 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5a977-9fa0-4ed6-9f97-0e88a9a4461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:12.945409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-8dc5a977-9fa0-4ed6-9f97-0e88a9a4461f None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:12.946615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-8dc5a977-9fa0-4ed6-9f97-0e88a9a4461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:12.954555 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 18:04:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:13.118503 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313530e-610d-4adf-a3f2-4565a641400b None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:13.131955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313530e-610d-4adf-a3f2-4565a641400b None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:13.136761 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ebae0-b999-4ac6-8cf8-0f471b6bf36c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:13.137379 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ebae0-b999-4ac6-8cf8-0f471b6bf36c service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:13.137686 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ebae0-b999-4ac6-8cf8-0f471b6bf36c service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:13.137955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ebae0-b999-4ac6-8cf8-0f471b6bf36c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:13.145756 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ebae0-b999-4ac6-8cf8-0f471b6bf36c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:13.148130 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ebae0-b999-4ac6-8cf8-0f471b6bf36c service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:13.157460 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 568/1141] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:14.665167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b0e7-a878-48f3-8d92-35328774878c None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:14.665737 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b0e7-a878-48f3-8d92-35328774878c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:14.665737 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46b0e7-a878-48f3-8d92-35328774878c None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:14.667099 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 574/1142] 10.222.0.48 () {54 vars in 961 bytes} [Fri Aug 19 18:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:14.672137 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3099fe6-5235-4fbf-9324-b62315936ac9 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:14.672562 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3099fe6-5235-4fbf-9324-b62315936ac9 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:14.672871 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3099fe6-5235-4fbf-9324-b62315936ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:14.691978 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-f3099fe6-5235-4fbf-9324-b62315936ac9 None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:14.699078 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-f3099fe6-5235-4fbf-9324-b62315936ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:14.701492 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 569/1143] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Aug 19 18:04:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:14.770418 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46b0e7-a878-48f3-8d92-35328774878c None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:14.783967 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46b0e7-a878-48f3-8d92-35328774878c None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:14.789577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d73055-176d-42ac-a170-7c019ce27c66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b03819209cf40619ba66506a8205b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:14.790175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73055-176d-42ac-a170-7c019ce27c66 service placement] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:14.790452 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73055-176d-42ac-a170-7c019ce27c66 service placement] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:14.790724 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73055-176d-42ac-a170-7c019ce27c66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:14.799035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d73055-176d-42ac-a170-7c019ce27c66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:14.800668 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d73055-176d-42ac-a170-7c019ce27c66 service placement] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:14.811072 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 575/1144] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:14 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:24.416146 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924372f8-63b4-4b94-a336-f9f202b8b60a None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:24.416769 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924372f8-63b4-4b94-a336-f9f202b8b60a None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:24.416769 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924372f8-63b4-4b94-a336-f9f202b8b60a None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:24.418056 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 18:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:24.423659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ff6c6-3d60-4169-8e20-fd3481e64eaf None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:24.423659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ff6c6-3d60-4169-8e20-fd3481e64eaf None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:24.423659 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ff6c6-3d60-4169-8e20-fd3481e64eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:24.444588 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-979ff6c6-3d60-4169-8e20-fd3481e64eaf None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:24.445813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-979ff6c6-3d60-4169-8e20-fd3481e64eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:24.453436 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 18:04:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:24.618117 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924372f8-63b4-4b94-a336-f9f202b8b60a None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:24.633084 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924372f8-63b4-4b94-a336-f9f202b8b60a None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:24.638111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd75cde-b078-4a05-bcab-fd430ac9c5e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:24.638718 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75cde-b078-4a05-bcab-fd430ac9c5e2 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:24.638998 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75cde-b078-4a05-bcab-fd430ac9c5e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:24.639274 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75cde-b078-4a05-bcab-fd430ac9c5e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:24.649061 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd75cde-b078-4a05-bcab-fd430ac9c5e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:24.650707 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd75cde-b078-4a05-bcab-fd430ac9c5e2 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:24.660522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 571/1147] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:25.486587 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa43ec-d349-4d29-9da2-122e782934dc None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:25.487158 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa43ec-d349-4d29-9da2-122e782934dc None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:25.487264 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa43ec-d349-4d29-9da2-122e782934dc None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:25.488750 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 19 18:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:25.493918 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a69f4-4203-4cec-aaa1-0f5df776f62a None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:25.494297 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a69f4-4203-4cec-aaa1-0f5df776f62a None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:25.494469 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a69f4-4203-4cec-aaa1-0f5df776f62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:25.514098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d48a69f4-4203-4cec-aaa1-0f5df776f62a None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:25.515305 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d48a69f4-4203-4cec-aaa1-0f5df776f62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:25.523955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 19 18:04:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:25.685265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa43ec-d349-4d29-9da2-122e782934dc None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:25.699419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa43ec-d349-4d29-9da2-122e782934dc None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:25.704460 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e602576-2c95-499f-be8c-ad5733e6269a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:25.705204 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602576-2c95-499f-be8c-ad5733e6269a service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:25.705318 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602576-2c95-499f-be8c-ad5733e6269a service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:25.705626 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602576-2c95-499f-be8c-ad5733e6269a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:25.713932 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e602576-2c95-499f-be8c-ad5733e6269a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:25.715513 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e602576-2c95-499f-be8c-ad5733e6269a service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:25.725519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 578/1150] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:29.816944 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584076c-4fc0-4faa-bcfd-b8d5f8a08e64 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:29.817528 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584076c-4fc0-4faa-bcfd-b8d5f8a08e64 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:29.817528 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584076c-4fc0-4faa-bcfd-b8d5f8a08e64 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:29.818836 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:29.830035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201a20a-275c-4c31-b329-acfe3bb9db65 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:29.830035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201a20a-275c-4c31-b329-acfe3bb9db65 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:29.830035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201a20a-275c-4c31-b329-acfe3bb9db65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:29.846265 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-c201a20a-275c-4c31-b329-acfe3bb9db65 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:29.847473 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-c201a20a-275c-4c31-b329-acfe3bb9db65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:29.855918 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:04:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:04:30.220270 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584076c-4fc0-4faa-bcfd-b8d5f8a08e64 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:30.222062 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d584076c-4fc0-4faa-bcfd-b8d5f8a08e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:30.228530 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=89 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:04:30.285483 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584076c-4fc0-4faa-bcfd-b8d5f8a08e64 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:30.289586 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa981c2-635b-44f9-a9bd-c8fac6c51561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:30.290189 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa981c2-635b-44f9-a9bd-c8fac6c51561 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:30.290465 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa981c2-635b-44f9-a9bd-c8fac6c51561 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:30.290735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa981c2-635b-44f9-a9bd-c8fac6c51561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:30.299550 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa981c2-635b-44f9-a9bd-c8fac6c51561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:30.300970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa981c2-635b-44f9-a9bd-c8fac6c51561 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:30.310344 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 574/1153] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:32.608778 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfce53-e33b-4ee5-be5b-02082ecc4d99 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:32.609370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfce53-e33b-4ee5-be5b-02082ecc4d99 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:32.609370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfce53-e33b-4ee5-be5b-02082ecc4d99 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:32.610676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:32.616726 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0455b-0c33-4b58-b084-be78768dd2d8 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:32.622466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0455b-0c33-4b58-b084-be78768dd2d8 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:32.622466 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0455b-0c33-4b58-b084-be78768dd2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:32.636627 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-0af0455b-0c33-4b58-b084-be78768dd2d8 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:32.637903 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-0af0455b-0c33-4b58-b084-be78768dd2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:32.645966 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:04:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:33.004612 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfce53-e33b-4ee5-be5b-02082ecc4d99 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:33.015890 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfce53-e33b-4ee5-be5b-02082ecc4d99 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:33.019502 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb5751-3bc1-4673-92e4-70b7982380b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:33.020101 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb5751-3bc1-4673-92e4-70b7982380b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:33.020379 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb5751-3bc1-4673-92e4-70b7982380b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:33.020652 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb5751-3bc1-4673-92e4-70b7982380b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:33.030665 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb5751-3bc1-4673-92e4-70b7982380b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:33.032093 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb5751-3bc1-4673-92e4-70b7982380b7 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:33.042566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 581/1156] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:37.188888 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7913-969f-4367-a73d-36cffc1bb0c2 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:37.189457 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7913-969f-4367-a73d-36cffc1bb0c2 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:37.189457 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7913-969f-4367-a73d-36cffc1bb0c2 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:37.190692 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 576/1157] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:37.196316 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f3d6-0ac7-4db2-9556-5653669c4a6a None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:37.196811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f3d6-0ac7-4db2-9556-5653669c4a6a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:37.196920 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040f3d6-0ac7-4db2-9556-5653669c4a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:37.216478 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-6040f3d6-0ac7-4db2-9556-5653669c4a6a None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:37.217728 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-6040f3d6-0ac7-4db2-9556-5653669c4a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:37.225389 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 582/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:04:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:37.806025 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e7913-969f-4367-a73d-36cffc1bb0c2 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:37.807778 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-2b9e7913-969f-4367-a73d-36cffc1bb0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:37.864114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e7913-969f-4367-a73d-36cffc1bb0c2 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:37.868221 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f573b-b65c-4747-8bd3-dfd2f1a331ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb05df536de4b159101ffa5cc41c5ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:37.868857 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f573b-b65c-4747-8bd3-dfd2f1a331ec service cinder] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:37.869141 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f573b-b65c-4747-8bd3-dfd2f1a331ec service cinder] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:37.869439 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f573b-b65c-4747-8bd3-dfd2f1a331ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:37.878191 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f573b-b65c-4747-8bd3-dfd2f1a331ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:37.879622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f573b-b65c-4747-8bd3-dfd2f1a331ec service cinder] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:37.889614 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 577/1159] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:40.140587 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1396-27c5-4bfd-8b13-4ba3cbede3aa None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:40.141167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1396-27c5-4bfd-8b13-4ba3cbede3aa None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:40.141167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1396-27c5-4bfd-8b13-4ba3cbede3aa None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:40.142512 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 583/1160] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 19 18:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:04:40.148533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133574-8116-4823-8723-4d372091dee2 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:40.148950 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133574-8116-4823-8723-4d372091dee2 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:40.149105 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1133574-8116-4823-8723-4d372091dee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:40.168838 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-a1133574-8116-4823-8723-4d372091dee2 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:04:40.170060 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-a1133574-8116-4823-8723-4d372091dee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:40.177970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 578/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 19 18:04:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:04:40.758943 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1396-27c5-4bfd-8b13-4ba3cbede3aa None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:04:40.760976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-85fe1396-27c5-4bfd-8b13-4ba3cbede3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:04:40.768972 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=37 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:04:40.775572 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1396-27c5-4bfd-8b13-4ba3cbede3aa None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:04:40.779376 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10641e70-1652-4a41-ac8d-261d8930ebef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb05df536de4b159101ffa5cc41c5ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:04:40.780783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10641e70-1652-4a41-ac8d-261d8930ebef service cinder] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:04:40.780783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10641e70-1652-4a41-ac8d-261d8930ebef service cinder] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:04:40.780783 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10641e70-1652-4a41-ac8d-261d8930ebef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:04:40.789919 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10641e70-1652-4a41-ac8d-261d8930ebef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:04:40.791350 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10641e70-1652-4a41-ac8d-261d8930ebef service cinder] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:04:40.800816 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 584/1162] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:04:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:04:50.163365 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=57 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:04:50.801819 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=5 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:05:57.502803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a3bd8-aa8e-45fc-aefb-c8d7770ac1e7 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.503415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a3bd8-aa8e-45fc-aefb-c8d7770ac1e7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.503415 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a3bd8-aa8e-45fc-aefb-c8d7770ac1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.510799 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e1f6-1f2b-421a-a9db-e3113f68d0a5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.511324 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e1f6-1f2b-421a-a9db-e3113f68d0a5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.511948 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1e1f6-1f2b-421a-a9db-e3113f68d0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.525892 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-208a3bd8-aa8e-45fc-aefb-c8d7770ac1e7 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:05:57.527813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-208a3bd8-aa8e-45fc-aefb-c8d7770ac1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:05:57.531917 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-20d1e1f6-1f2b-421a-a9db-e3113f68d0a5 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:05:57.533100 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-20d1e1f6-1f2b-421a-a9db-e3113f68d0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:05:57.537687 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 579/1163] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:05:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:05:57.544039 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 585/1164] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:05:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:05:57.545558 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891110be-d5a0-4a99-a97f-87fe58f67742 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.545844 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891110be-d5a0-4a99-a97f-87fe58f67742 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.546122 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891110be-d5a0-4a99-a97f-87fe58f67742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.548993 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525740-6a46-445a-b5b0-459344d725e8 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.549277 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525740-6a46-445a-b5b0-459344d725e8 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.549582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525740-6a46-445a-b5b0-459344d725e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.566146 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-891110be-d5a0-4a99-a97f-87fe58f67742 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:05:57.567360 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-891110be-d5a0-4a99-a97f-87fe58f67742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:05:57.568962 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-35525740-6a46-445a-b5b0-459344d725e8 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:05:57.570184 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-35525740-6a46-445a-b5b0-459344d725e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:05:57.576397 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 580/1165] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:05:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:05:57.578941 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 586/1166] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:05:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:05:57.580751 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891110be-d5a0-4a99-a97f-87fe58f67742 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:57.583087 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525740-6a46-445a-b5b0-459344d725e8 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:57.591044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891110be-d5a0-4a99-a97f-87fe58f67742 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:57.594509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525740-6a46-445a-b5b0-459344d725e8 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:57.595800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:57.596401 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.596681 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.596951 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] PATH_INFO: `/v3/domains` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.597258 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:57.597635 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 18:05:57.597890 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.597999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:57.598172 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.598445 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.599082 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88352) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 19 18:05:57.599389 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:57.599524 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:57.600410 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING py.warnings [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:05:57.600410 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: warnings.warn(msg) Aug 19 18:05:57.600410 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: Aug 19 18:05:57.601325 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:57.611970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 581/1167] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Aug 19 18:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 18:05:57.618639 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 587/1168] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Aug 19 18:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 19 18:05:57.623280 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:57.623408 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:57.630870 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff625ad-293b-4487-a335-cc54dfd77efa admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:57.631925 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03910c94-fd5a-48fe-bf28-3dda650834f7 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:57.635418 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:57.636024 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.636304 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.637079 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81d928-0a17-4dda-b09c-c7c196e7073a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:57.637198 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.637747 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d928-0a17-4dda-b09c-c7c196e7073a admin admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.637967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:57.638071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d928-0a17-4dda-b09c-c7c196e7073a admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.638281 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81d928-0a17-4dda-b09c-c7c196e7073a admin admin] PATH_INFO: `/v3/projects` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.638892 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81d928-0a17-4dda-b09c-c7c196e7073a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:57.639004 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING py.warnings [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:05:57.639004 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: warnings.warn(msg) Aug 19 18:05:57.639004 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: Aug 19 18:05:57.640149 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:57.640793 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81d928-0a17-4dda-b09c-c7c196e7073a admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:57.771017 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 582/1169] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Aug 19 18:05:57 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 18:05:57.775346 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:57.807754 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 588/1170] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Aug 19 18:05:57 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 18:05:57.809333 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81d928-0a17-4dda-b09c-c7c196e7073a admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:57.840005 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828aee4-70e4-4830-8c6a-4cf29be1791d admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:57.874580 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81d928-0a17-4dda-b09c-c7c196e7073a admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:57.879271 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:57.879898 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.880199 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.880478 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.881131 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:57.882259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING py.warnings [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:05:57.882259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: warnings.warn(msg) Aug 19 18:05:57.882259 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: Aug 19 18:05:57.883516 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:57.897374 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fb082-2753-4894-9f8f-cfca6e87de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:57.898022 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fb082-2753-4894-9f8f-cfca6e87de37 admin admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:57.898302 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fb082-2753-4894-9f8f-cfca6e87de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:57.898622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fb082-2753-4894-9f8f-cfca6e87de37 admin admin] PATH_INFO: `/v3/users` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:57.899224 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fb082-2753-4894-9f8f-cfca6e87de37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:57.901460 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074fb082-2753-4894-9f8f-cfca6e87de37 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.029391 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 589/1171] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 18:05:57 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 18:05:58.033679 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:58.042446 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 583/1172] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 18:05:57 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 19 18:05:58.044284 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fb082-2753-4894-9f8f-cfca6e87de37 admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:58.047489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41dd2-ec87-4c93-a5d8-8b01c25df40e admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:58.054393 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fb082-2753-4894-9f8f-cfca6e87de37 admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:58.054566 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2a11-8395-4e0d-b12a-c5af95ed3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:58.055174 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2a11-8395-4e0d-b12a-c5af95ed3e60 admin admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.055459 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2a11-8395-4e0d-b12a-c5af95ed3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.055732 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2a11-8395-4e0d-b12a-c5af95ed3e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.056481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f2a11-8395-4e0d-b12a-c5af95ed3e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:58.058143 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f2a11-8395-4e0d-b12a-c5af95ed3e60 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.060637 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8614c8-e468-4300-83d3-79868461dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:58.060910 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8614c8-e468-4300-83d3-79868461dbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.061185 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8614c8-e468-4300-83d3-79868461dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.061481 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8614c8-e468-4300-83d3-79868461dbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.062114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8614c8-e468-4300-83d3-79868461dbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:58.063683 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8614c8-e468-4300-83d3-79868461dbe5 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.071729 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 590/1173] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 18:05:58.076449 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 584/1174] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 18:05:58.076605 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2a11-8395-4e0d-b12a-c5af95ed3e60 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:58.077371 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8614c8-e468-4300-83d3-79868461dbe5 admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:58.086967 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8614c8-e468-4300-83d3-79868461dbe5 admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:58.087732 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2a11-8395-4e0d-b12a-c5af95ed3e60 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:58.091851 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722427-cb3d-40c7-9dfe-a5c9b18fdb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:58.092472 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722427-cb3d-40c7-9dfe-a5c9b18fdb85 admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.092612 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3af1-1803-4b73-9afa-1a2db7f3cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:58.092735 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722427-cb3d-40c7-9dfe-a5c9b18fdb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.093008 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45722427-cb3d-40c7-9dfe-a5c9b18fdb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.093670 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45722427-cb3d-40c7-9dfe-a5c9b18fdb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:58.093789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3af1-1803-4b73-9afa-1a2db7f3cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.094066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3af1-1803-4b73-9afa-1a2db7f3cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.094337 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3af1-1803-4b73-9afa-1a2db7f3cc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.094992 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee3af1-1803-4b73-9afa-1a2db7f3cc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:58.095340 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45722427-cb3d-40c7-9dfe-a5c9b18fdb85 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.096595 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee3af1-1803-4b73-9afa-1a2db7f3cc9a admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.106628 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 585/1175] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 18:05:58.110128 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 591/1176] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 18:05:58.111086 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3af1-1803-4b73-9afa-1a2db7f3cc9a admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:58.111227 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722427-cb3d-40c7-9dfe-a5c9b18fdb85 admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:58.120825 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3af1-1803-4b73-9afa-1a2db7f3cc9a admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:58.121632 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45722427-cb3d-40c7-9dfe-a5c9b18fdb85 admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:58.126232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4d24d-b766-420f-83be-c768c14f2878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:58.126481 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cb9f0-eb67-484b-a990-1d162d9cb2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:58.126871 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d24d-b766-420f-83be-c768c14f2878 admin admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.127137 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cb9f0-eb67-484b-a990-1d162d9cb2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.127263 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d24d-b766-420f-83be-c768c14f2878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.127404 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4d24d-b766-420f-83be-c768c14f2878 admin admin] PATH_INFO: `/v3/projects/341e7537e4c84625be31484e1d6bcd3b/users/5c912ffef66a44a1a85108e26845edfc/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.127511 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cb9f0-eb67-484b-a990-1d162d9cb2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.127677 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cb9f0-eb67-484b-a990-1d162d9cb2d6 admin admin] PATH_INFO: `/v3/projects/f751d059104b4c54a9a38df15a1ad235/users/a2456362e27445dfa259b538cdd5b348/roles/6126abc4720c4543854a6fd2ddfacbbf` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.142215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4d24d-b766-420f-83be-c768c14f2878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341e7537e4c84625be31484e1d6bcd3b, user_id=5c912ffef66a44a1a85108e26845edfc, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:58.142522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cb9f0-eb67-484b-a990-1d162d9cb2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f751d059104b4c54a9a38df15a1ad235, user_id=a2456362e27445dfa259b538cdd5b348, role_id=6126abc4720c4543854a6fd2ddfacbbf)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:58.143544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING py.warnings [None req-a33cb9f0-eb67-484b-a990-1d162d9cb2d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:05:58.143544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: warnings.warn(msg) Aug 19 18:05:58.143544 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: Aug 19 18:05:58.144895 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4d24d-b766-420f-83be-c768c14f2878 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.145521 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cb9f0-eb67-484b-a990-1d162d9cb2d6 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.216509 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 592/1177] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Aug 19 18:05:58 2022] PUT /identity/v3/projects/341e7537e4c84625be31484e1d6bcd3b/users/5c912ffef66a44a1a85108e26845edfc/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:05:58.221594 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1eb3-9f9f-4e5d-89cb-b054b739eee5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.222562 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1eb3-9f9f-4e5d-89cb-b054b739eee5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.222562 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1eb3-9f9f-4e5d-89cb-b054b739eee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.241230 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-0a5b1eb3-9f9f-4e5d-89cb-b054b739eee5 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:05:58.242464 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-0a5b1eb3-9f9f-4e5d-89cb-b054b739eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:05:58.245560 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 586/1178] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Aug 19 18:05:58 2022] PUT /identity/v3/projects/f751d059104b4c54a9a38df15a1ad235/users/a2456362e27445dfa259b538cdd5b348/roles/6126abc4720c4543854a6fd2ddfacbbf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 18:05:58.251504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6a53-d9ec-4dcd-af64-c9da821662c1 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.251795 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6a53-d9ec-4dcd-af64-c9da821662c1 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.252078 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b6a53-d9ec-4dcd-af64-c9da821662c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.259098 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:05:58.271167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-cd9b6a53-d9ec-4dcd-af64-c9da821662c1 None None] MFA Rules not processed for user `bd3642203b2a4a53b69987de767c8bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:05:58.272444 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-cd9b6a53-d9ec-4dcd-af64-c9da821662c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:05:58.292700 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:05:58.307598 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 593/1179] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:05:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:05:58.315836 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1eb3-9f9f-4e5d-89cb-b054b739eee5 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:58.317215 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-0a5b1eb3-9f9f-4e5d-89cb-b054b739eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:05:58.336134 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 587/1180] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:05:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:05:58.353041 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b6a53-d9ec-4dcd-af64-c9da821662c1 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:05:58.354504 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-cd9b6a53-d9ec-4dcd-af64-c9da821662c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:05:58.375792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1eb3-9f9f-4e5d-89cb-b054b739eee5 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:58.379381 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552537e5-b010-46a7-b9c4-76e038685575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:58.379982 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552537e5-b010-46a7-b9c4-76e038685575 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.380395 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552537e5-b010-46a7-b9c4-76e038685575 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.380670 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552537e5-b010-46a7-b9c4-76e038685575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.390288 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552537e5-b010-46a7-b9c4-76e038685575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:58.391726 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552537e5-b010-46a7-b9c4-76e038685575 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.401720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 594/1181] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:05:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 18:05:58.412259 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b6a53-d9ec-4dcd-af64-c9da821662c1 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:05:58.415897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dfa92-c051-4b9e-93d5-34ec3fe22d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:05:58.416501 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dfa92-c051-4b9e-93d5-34ec3fe22d57 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:05:58.416776 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dfa92-c051-4b9e-93d5-34ec3fe22d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:05:58.417045 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dfa92-c051-4b9e-93d5-34ec3fe22d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:05:58.426941 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dfa92-c051-4b9e-93d5-34ec3fe22d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:05:58.428365 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dfa92-c051-4b9e-93d5-34ec3fe22d57 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:05:58.438000 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 588/1182] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:05:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 18:06:04.883382 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344ab73-affe-4a99-afaf-b42849151c74 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:04.883974 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344ab73-affe-4a99-afaf-b42849151c74 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:04.887091 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344ab73-affe-4a99-afaf-b42849151c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:04.979976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-d344ab73-affe-4a99-afaf-b42849151c74 None None] MFA Rules not processed for user `5c912ffef66a44a1a85108e26845edfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:04.979976 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-d344ab73-affe-4a99-afaf-b42849151c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:05.036149 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 595/1183] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:06:04 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:05.040799 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dfa92-c051-4b9e-93d5-34ec3fe22d57 service neutron] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:05.053908 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dfa92-c051-4b9e-93d5-34ec3fe22d57 service neutron] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:05.059578 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569a03b-673b-401a-b459-10718486cfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:05.060366 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569a03b-673b-401a-b459-10718486cfad admin admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:05.060555 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569a03b-673b-401a-b459-10718486cfad admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:05.060869 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569a03b-673b-401a-b459-10718486cfad admin admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:05.061493 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569a03b-673b-401a-b459-10718486cfad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:05.064513 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4569a03b-673b-401a-b459-10718486cfad admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:05.193583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344ab73-affe-4a99-afaf-b42849151c74 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:05.201437 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 589/1184] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Aug 19 18:06:05 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 18:06:05.212855 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344ab73-affe-4a99-afaf-b42849151c74 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:05.284573 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ad0eb-c1df-40e0-9b45-d53c8514d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:05.285466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad0eb-c1df-40e0-9b45-d53c8514d63d admin admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:05.285905 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad0eb-c1df-40e0-9b45-d53c8514d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:05.286322 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ad0eb-c1df-40e0-9b45-d53c8514d63d admin admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:05.286832 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ad0eb-c1df-40e0-9b45-d53c8514d63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:05.289270 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ad0eb-c1df-40e0-9b45-d53c8514d63d admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:05.461167 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 596/1185] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 18:06:05 2022] POST /identity/v3/users => generated 298 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 18:06:05.462744 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569a03b-673b-401a-b459-10718486cfad admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:05.477223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569a03b-673b-401a-b459-10718486cfad admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:05.492342 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a0302-f15d-43ad-9815-0fc3b65b5f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:05.493212 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a0302-f15d-43ad-9815-0fc3b65b5f23 admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:05.493738 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a0302-f15d-43ad-9815-0fc3b65b5f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:05.494193 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a0302-f15d-43ad-9815-0fc3b65b5f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:05.495126 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a0302-f15d-43ad-9815-0fc3b65b5f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:05.498718 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a0302-f15d-43ad-9815-0fc3b65b5f23 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:05.517585 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 590/1186] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 18:06:05.521853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ad0eb-c1df-40e0-9b45-d53c8514d63d admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:05.532831 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ad0eb-c1df-40e0-9b45-d53c8514d63d admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:05.541120 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f48cf3-3c41-4f8c-acc2-5f5342656a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:05.542032 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f48cf3-3c41-4f8c-acc2-5f5342656a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:05.542236 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f48cf3-3c41-4f8c-acc2-5f5342656a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:05.543028 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f48cf3-3c41-4f8c-acc2-5f5342656a8a admin admin] PATH_INFO: `/v3/projects/6eb94c59b5864ef8adfd8b2ea84c6281/users/6dcf2ad2aeeb493e9d5bc839edf9bcdb/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:05.567796 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f48cf3-3c41-4f8c-acc2-5f5342656a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb94c59b5864ef8adfd8b2ea84c6281, user_id=6dcf2ad2aeeb493e9d5bc839edf9bcdb, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:05.571423 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f48cf3-3c41-4f8c-acc2-5f5342656a8a admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:05.575021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:06:05.707141 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd27c31-903c-49d1-bc82-112e01b9468e None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:05.707535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 597/1187] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Aug 19 18:06:05 2022] PUT /identity/v3/projects/6eb94c59b5864ef8adfd8b2ea84c6281/users/6dcf2ad2aeeb493e9d5bc839edf9bcdb/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:06:05.708464 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd27c31-903c-49d1-bc82-112e01b9468e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:05.708769 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd27c31-903c-49d1-bc82-112e01b9468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:05.711369 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f48cf3-3c41-4f8c-acc2-5f5342656a8a admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:05.747021 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-4fd27c31-903c-49d1-bc82-112e01b9468e None None] MFA Rules not processed for user `a2456362e27445dfa259b538cdd5b348`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:05.748263 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-4fd27c31-903c-49d1-bc82-112e01b9468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:05.789283 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f48cf3-3c41-4f8c-acc2-5f5342656a8a admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:05.800123 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d2980-27c1-4756-a387-c9f21dead990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:05.800827 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d2980-27c1-4756-a387-c9f21dead990 admin admin] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:05.801175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d2980-27c1-4756-a387-c9f21dead990 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:05.801570 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d2980-27c1-4756-a387-c9f21dead990 admin admin] PATH_INFO: `/v3/roles` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:05.802302 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d2980-27c1-4756-a387-c9f21dead990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:05.804789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d2980-27c1-4756-a387-c9f21dead990 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:05.821462 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 598/1188] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 19 18:06:05.825021 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d2980-27c1-4756-a387-c9f21dead990 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:05.841345 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d2980-27c1-4756-a387-c9f21dead990 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:05.856919 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041ebee-029d-4ee0-b546-215de23dca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:05.857384 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ebee-029d-4ee0-b546-215de23dca55 admin admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:05.857694 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ebee-029d-4ee0-b546-215de23dca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:05.857965 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041ebee-029d-4ee0-b546-215de23dca55 admin admin] PATH_INFO: `/v3/projects/6eb94c59b5864ef8adfd8b2ea84c6281/users/6dcf2ad2aeeb493e9d5bc839edf9bcdb/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:05.861838 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041ebee-029d-4ee0-b546-215de23dca55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb94c59b5864ef8adfd8b2ea84c6281, user_id=6dcf2ad2aeeb493e9d5bc839edf9bcdb, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:05.865293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041ebee-029d-4ee0-b546-215de23dca55 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:05.873868 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 591/1189] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:06:05 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:06:05.877739 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd27c31-903c-49d1-bc82-112e01b9468e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:05.877944 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 599/1190] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Aug 19 18:06:05 2022] PUT /identity/v3/projects/6eb94c59b5864ef8adfd8b2ea84c6281/users/6dcf2ad2aeeb493e9d5bc839edf9bcdb/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:06:05.891813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:06:05.899926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd27c31-903c-49d1-bc82-112e01b9468e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:05.970433 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028fbb2-d9ef-4d9d-85e2-7b42920e9956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:05.971070 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028fbb2-d9ef-4d9d-85e2-7b42920e9956 admin admin] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:05.971350 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028fbb2-d9ef-4d9d-85e2-7b42920e9956 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:05.971661 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028fbb2-d9ef-4d9d-85e2-7b42920e9956 admin admin] PATH_INFO: `/v3/projects` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:05.972289 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028fbb2-d9ef-4d9d-85e2-7b42920e9956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:05.974341 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028fbb2-d9ef-4d9d-85e2-7b42920e9956 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:06.087538 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 592/1191] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Aug 19 18:06:05 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 18:06:06.091822 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041ebee-029d-4ee0-b546-215de23dca55 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:06.103804 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041ebee-029d-4ee0-b546-215de23dca55 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:06.204993 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca442a2-59c2-4238-aeb3-83103de2483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:06.205676 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca442a2-59c2-4238-aeb3-83103de2483d admin admin] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:06.206753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca442a2-59c2-4238-aeb3-83103de2483d admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:06.206753 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca442a2-59c2-4238-aeb3-83103de2483d admin admin] PATH_INFO: `/v3/users` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:06.206947 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca442a2-59c2-4238-aeb3-83103de2483d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:06.209913 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca442a2-59c2-4238-aeb3-83103de2483d admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:06.369884 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 600/1192] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Aug 19 18:06:06 2022] POST /identity/v3/users => generated 295 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 19 18:06:06.375071 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028fbb2-d9ef-4d9d-85e2-7b42920e9956 admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:06.392947 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028fbb2-d9ef-4d9d-85e2-7b42920e9956 admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:06.398298 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444ac0-b971-4cf6-b294-7eb2846d7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:06.398941 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444ac0-b971-4cf6-b294-7eb2846d7063 admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:06.399221 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444ac0-b971-4cf6-b294-7eb2846d7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:06.399547 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5444ac0-b971-4cf6-b294-7eb2846d7063 admin admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:06.400508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5444ac0-b971-4cf6-b294-7eb2846d7063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:06.402891 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5444ac0-b971-4cf6-b294-7eb2846d7063 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:06.418622 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 593/1193] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 18:06:06.419777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca442a2-59c2-4238-aeb3-83103de2483d admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:06.431962 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca442a2-59c2-4238-aeb3-83103de2483d admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:06.438419 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6c56c-762e-46f7-8a2a-5c4d931c51c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:06.439294 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c56c-762e-46f7-8a2a-5c4d931c51c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:06.439575 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c56c-762e-46f7-8a2a-5c4d931c51c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:06.439851 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6c56c-762e-46f7-8a2a-5c4d931c51c4 admin admin] PATH_INFO: `/v3/projects/f449efb7a0b043a99ceef58858fe9ace/users/d2c2a5b9bec544ea87bc9232ecef01ea/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:06.464661 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6c56c-762e-46f7-8a2a-5c4d931c51c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f449efb7a0b043a99ceef58858fe9ace, user_id=d2c2a5b9bec544ea87bc9232ecef01ea, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:06.467850 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6c56c-762e-46f7-8a2a-5c4d931c51c4 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:06.569012 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 601/1194] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Aug 19 18:06:06 2022] PUT /identity/v3/projects/f449efb7a0b043a99ceef58858fe9ace/users/d2c2a5b9bec544ea87bc9232ecef01ea/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:06:06.570117 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444ac0-b971-4cf6-b294-7eb2846d7063 admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:06.588651 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5444ac0-b971-4cf6-b294-7eb2846d7063 admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:06.712900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f138f-7bf5-4055-80e5-6afc13f65a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:06.713648 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f138f-7bf5-4055-80e5-6afc13f65a7a admin admin] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:06.713953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f138f-7bf5-4055-80e5-6afc13f65a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:06.714894 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f138f-7bf5-4055-80e5-6afc13f65a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:06.715598 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f138f-7bf5-4055-80e5-6afc13f65a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:06.717534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f138f-7bf5-4055-80e5-6afc13f65a7a admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:06.732542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 594/1195] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Aug 19 18:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 19 18:06:06.733409 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6c56c-762e-46f7-8a2a-5c4d931c51c4 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:06.749924 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6c56c-762e-46f7-8a2a-5c4d931c51c4 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:06.762636 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:06.763375 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:06.763647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:06.763915 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] PATH_INFO: `/v3/projects/f449efb7a0b043a99ceef58858fe9ace/users/d2c2a5b9bec544ea87bc9232ecef01ea/roles/757702b4209942a3b2ec7bf21d995169` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:06.767847 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f449efb7a0b043a99ceef58858fe9ace, user_id=d2c2a5b9bec544ea87bc9232ecef01ea, role_id=757702b4209942a3b2ec7bf21d995169)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:06.773519 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:06.813246 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 602/1196] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Aug 19 18:06:06 2022] PUT /identity/v3/projects/f449efb7a0b043a99ceef58858fe9ace/users/d2c2a5b9bec544ea87bc9232ecef01ea/roles/757702b4209942a3b2ec7bf21d995169 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 18:06:13.198392 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a37e-da25-41f0-ae03-44dfdbaac84c None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:13.199837 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a37e-da25-41f0-ae03-44dfdbaac84c None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:13.200275 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9a37e-da25-41f0-ae03-44dfdbaac84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:13.246831 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e0a9a37e-da25-41f0-ae03-44dfdbaac84c None None] MFA Rules not processed for user `6dcf2ad2aeeb493e9d5bc839edf9bcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:13.248123 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e0a9a37e-da25-41f0-ae03-44dfdbaac84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:13.380512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:06:13.387759 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 595/1197] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:06:13 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:13.402628 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:13.405603 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:13.447483 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:06:13.497448 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096fcb8-0db6-495a-9054-a6933f4a50e6 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:13.508268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c577-7d95-46a0-8d5d-f7014cdf423a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d52483e48804cbfad701d198deea470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:13.508268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c577-7d95-46a0-8d5d-f7014cdf423a service glance] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:13.508268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c577-7d95-46a0-8d5d-f7014cdf423a service glance] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:13.508268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c577-7d95-46a0-8d5d-f7014cdf423a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:13.583065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229c577-7d95-46a0-8d5d-f7014cdf423a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:13.584673 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229c577-7d95-46a0-8d5d-f7014cdf423a service glance] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:13.596303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 603/1198] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:13 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:06:14.358768 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86f2d-ad3a-4823-9d4c-bea02bb4607b None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:14.358768 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86f2d-ad3a-4823-9d4c-bea02bb4607b None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:14.358768 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c86f2d-ad3a-4823-9d4c-bea02bb4607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:14.388173 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d1c86f2d-ad3a-4823-9d4c-bea02bb4607b None None] MFA Rules not processed for user `d2c2a5b9bec544ea87bc9232ecef01ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:14.389580 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d1c86f2d-ad3a-4823-9d4c-bea02bb4607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:14.505234 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 596/1199] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:06:14 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:14.523280 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c577-7d95-46a0-8d5d-f7014cdf423a service glance] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:14.534154 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c577-7d95-46a0-8d5d-f7014cdf423a service glance] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:14.539102 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed870a-ff24-426b-b6d6-83fc7d8c8792 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d52483e48804cbfad701d198deea470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:14.540163 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed870a-ff24-426b-b6d6-83fc7d8c8792 service glance] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:14.540745 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed870a-ff24-426b-b6d6-83fc7d8c8792 service glance] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:14.541260 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed870a-ff24-426b-b6d6-83fc7d8c8792 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:14.629087 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed870a-ff24-426b-b6d6-83fc7d8c8792 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:14.630792 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed870a-ff24-426b-b6d6-83fc7d8c8792 service glance] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:14.649634 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 604/1200] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:14 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:06:23.510576 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333fc5d-df38-448d-83e7-3b562a78b298 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:23.511742 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333fc5d-df38-448d-83e7-3b562a78b298 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:23.511867 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333fc5d-df38-448d-83e7-3b562a78b298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:23.534830 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-5333fc5d-df38-448d-83e7-3b562a78b298 None None] MFA Rules not processed for user `5c912ffef66a44a1a85108e26845edfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:23.536166 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-5333fc5d-df38-448d-83e7-3b562a78b298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:23.543857 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 597/1201] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:06:23 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:23.864521 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd50e4-2f5f-4fd8-a99b-55a1f38bd5ab None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:23.865065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd50e4-2f5f-4fd8-a99b-55a1f38bd5ab None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:23.865065 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd50e4-2f5f-4fd8-a99b-55a1f38bd5ab None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:23.866674 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 605/1202] 10.222.0.48 () {54 vars in 962 bytes} [Fri Aug 19 18:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:06:23.876352 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435e98-738c-4409-a924-790c2536abed None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:23.876642 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435e98-738c-4409-a924-790c2536abed None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:23.876921 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435e98-738c-4409-a924-790c2536abed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:23.900683 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-f3435e98-738c-4409-a924-790c2536abed None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:23.902110 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-f3435e98-738c-4409-a924-790c2536abed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:23.971893 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 598/1203] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Aug 19 18:06:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:23.977642 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11639a-66da-4581-b809-8e1787ea65d8 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:23.977925 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11639a-66da-4581-b809-8e1787ea65d8 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:23.978197 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11639a-66da-4581-b809-8e1787ea65d8 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:23.979629 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 606/1204] 10.222.0.48 () {54 vars in 912 bytes} [Fri Aug 19 18:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:06:23.984975 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2394-7049-4b52-a878-2761aed35540 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:23.985269 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2394-7049-4b52-a878-2761aed35540 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:23.985600 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2394-7049-4b52-a878-2761aed35540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:24.010282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-c96d2394-7049-4b52-a878-2761aed35540 None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:24.010282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-c96d2394-7049-4b52-a878-2761aed35540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:24.019650 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 599/1205] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Aug 19 18:06:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:24.032407 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11639a-66da-4581-b809-8e1787ea65d8 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:24.035985 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-1e11639a-66da-4581-b809-8e1787ea65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:24.051050 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11639a-66da-4581-b809-8e1787ea65d8 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:24.054677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced8db3-3fad-4f78-807f-b16ef372a75f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d52483e48804cbfad701d198deea470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:24.055809 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8db3-3fad-4f78-807f-b16ef372a75f service glance] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:24.055936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8db3-3fad-4f78-807f-b16ef372a75f service glance] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:24.056216 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8db3-3fad-4f78-807f-b16ef372a75f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:24.067680 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced8db3-3fad-4f78-807f-b16ef372a75f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:24.070606 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced8db3-3fad-4f78-807f-b16ef372a75f service glance] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:24.087875 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 607/1206] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:06:24.478813 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e383b-1ecc-45b4-a8c4-e0696d9bcb25 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:24.479244 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e383b-1ecc-45b4-a8c4-e0696d9bcb25 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:24.479506 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e383b-1ecc-45b4-a8c4-e0696d9bcb25 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:24.480942 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 600/1207] 10.222.0.48 () {54 vars in 912 bytes} [Fri Aug 19 18:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:06:24.489474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e876-28b2-4e77-bf0f-54491dc90888 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:24.489474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e876-28b2-4e77-bf0f-54491dc90888 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:24.489474 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472e876-28b2-4e77-bf0f-54491dc90888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:24.507973 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-8472e876-28b2-4e77-bf0f-54491dc90888 None None] MFA Rules not processed for user `b864fd056be54f2986135bbb77bdf7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:24.509213 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-8472e876-28b2-4e77-bf0f-54491dc90888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:24.562752 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 608/1208] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Aug 19 18:06:24 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:24.574738 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e383b-1ecc-45b4-a8c4-e0696d9bcb25 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:24.586808 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e383b-1ecc-45b4-a8c4-e0696d9bcb25 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:24.590568 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea1b8f-a6f8-4519-bd73-ee8d93601bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:24.591403 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea1b8f-a6f8-4519-bd73-ee8d93601bcd service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:24.591678 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea1b8f-a6f8-4519-bd73-ee8d93601bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:24.591949 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea1b8f-a6f8-4519-bd73-ee8d93601bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:24.599617 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea1b8f-a6f8-4519-bd73-ee8d93601bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:24.601042 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea1b8f-a6f8-4519-bd73-ee8d93601bcd service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:24.609282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 601/1209] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:24 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:06:25.086534 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d672a-59f4-4c78-80b7-f78a35e3c858 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:25.087093 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d672a-59f4-4c78-80b7-f78a35e3c858 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:25.087093 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d672a-59f4-4c78-80b7-f78a35e3c858 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:25.088530 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 609/1210] 10.222.0.48 () {54 vars in 962 bytes} [Fri Aug 19 18:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:06:25.094484 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa232e1-86be-4352-87a9-4bef44b9eb8e None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:25.094793 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa232e1-86be-4352-87a9-4bef44b9eb8e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:25.095066 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa232e1-86be-4352-87a9-4bef44b9eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:25.123600 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e3cc-0bd4-4cf6-8a08-88062285d0c1 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:25.123882 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e3cc-0bd4-4cf6-8a08-88062285d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:25.124157 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8e3cc-0bd4-4cf6-8a08-88062285d0c1 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:25.125129 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-9fa232e1-86be-4352-87a9-4bef44b9eb8e None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:25.125811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 610/1211] 10.222.0.48 () {54 vars in 961 bytes} [Fri Aug 19 18:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:06:25.130480 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-9fa232e1-86be-4352-87a9-4bef44b9eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:25.130791 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76788-1d9e-4758-87a6-8aa97e71a02a None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:25.131071 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76788-1d9e-4758-87a6-8aa97e71a02a None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:25.131343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76788-1d9e-4758-87a6-8aa97e71a02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:25.140965 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 602/1212] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Aug 19 18:06:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:06:25.147543 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8806f1-a7e5-4384-902c-cc1ec422f020 None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:25.147829 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8806f1-a7e5-4384-902c-cc1ec422f020 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:25.148111 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8806f1-a7e5-4384-902c-cc1ec422f020 None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:25.149451 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 603/1213] 10.222.0.48 () {54 vars in 912 bytes} [Fri Aug 19 18:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 19 18:06:25.158756 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-94c76788-1d9e-4758-87a6-8aa97e71a02a None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:25.160006 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-94c76788-1d9e-4758-87a6-8aa97e71a02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:25.170846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c562b-e8b8-443c-a7fa-3be0345c88c7 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:25.171130 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c562b-e8b8-443c-a7fa-3be0345c88c7 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:25.171404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c562b-e8b8-443c-a7fa-3be0345c88c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:25.180239 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=100 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:06:25.211968 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-c82c562b-e8b8-443c-a7fa-3be0345c88c7 None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:25.213214 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-c82c562b-e8b8-443c-a7fa-3be0345c88c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:25.235517 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 604/1214] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Aug 19 18:06:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:25.240282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c562b-e8b8-443c-a7fa-3be0345c88c7 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:25.250721 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c562b-e8b8-443c-a7fa-3be0345c88c7 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:25.251936 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 611/1215] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Aug 19 18:06:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:25.256775 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afe067-8b41-4dba-8bb1-dc0514696219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:25.257565 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe067-8b41-4dba-8bb1-dc0514696219 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:25.259099 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe067-8b41-4dba-8bb1-dc0514696219 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:25.259386 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe067-8b41-4dba-8bb1-dc0514696219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:25.260511 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c76788-1d9e-4758-87a6-8aa97e71a02a None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:25.271081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afe067-8b41-4dba-8bb1-dc0514696219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:25.271323 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c76788-1d9e-4758-87a6-8aa97e71a02a None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:25.272514 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afe067-8b41-4dba-8bb1-dc0514696219 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:25.279496 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b03819209cf40619ba66506a8205b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:25.280192 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:25.280535 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:25.280978 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:25.282825 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:25.284803 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 605/1216] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:06:25.297712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:25.299421 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:25.314211 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 612/1217] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:25 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:06:35.280352 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=88 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:06:35.306755 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=27 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:06:37.069552 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6ded6-66c1-4b05-808a-ad29250d0eff None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:37.070088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6ded6-66c1-4b05-808a-ad29250d0eff None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:37.070088 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6ded6-66c1-4b05-808a-ad29250d0eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:37.091531 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-1bb6ded6-66c1-4b05-808a-ad29250d0eff None None] MFA Rules not processed for user `b864fd056be54f2986135bbb77bdf7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:37.092897 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-1bb6ded6-66c1-4b05-808a-ad29250d0eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:37.100443 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 606/1218] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 19 18:06:37 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:37.111899 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:37.121607 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e94401-7db2-4642-9428-480c4fb73680 service placement] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:37.125205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e0067-ad1b-42d5-b452-6f79a166cf6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:37.125849 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0067-ad1b-42d5-b452-6f79a166cf6b service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:37.126125 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0067-ad1b-42d5-b452-6f79a166cf6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:37.126394 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0067-ad1b-42d5-b452-6f79a166cf6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:37.133458 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e0067-ad1b-42d5-b452-6f79a166cf6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:37.135735 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e0067-ad1b-42d5-b452-6f79a166cf6b service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:37.143715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 613/1219] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:37 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:06:38.211955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d66a0-9b75-4b49-b61f-f2098369a32e None None] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:38.212507 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d66a0-9b75-4b49-b61f-f2098369a32e None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:38.212507 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d66a0-9b75-4b49-b61f-f2098369a32e None None] PATH_INFO: `/` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:38.215033 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 607/1220] 10.222.0.48 () {54 vars in 921 bytes} [Fri Aug 19 18:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:06:38.235481 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19034af-6249-4754-adc6-effd39620072 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:38.236583 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19034af-6249-4754-adc6-effd39620072 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:38.236862 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19034af-6249-4754-adc6-effd39620072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:38.260903 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-f19034af-6249-4754-adc6-effd39620072 None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:38.262170 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-f19034af-6249-4754-adc6-effd39620072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:38.271396 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 614/1221] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Aug 19 18:06:38 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:38.304081 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d66a0-9b75-4b49-b61f-f2098369a32e None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:38.313406 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d66a0-9b75-4b49-b61f-f2098369a32e None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:38.318667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e82659-070b-496b-b8a1-46976b205d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:38.319445 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82659-070b-496b-b8a1-46976b205d91 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:38.319924 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82659-070b-496b-b8a1-46976b205d91 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:38.320204 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e82659-070b-496b-b8a1-46976b205d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:38.329757 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e82659-070b-496b-b8a1-46976b205d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:38.332873 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e82659-070b-496b-b8a1-46976b205d91 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:38.342160 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 608/1222] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:38 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:06:47.560129 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65aa0-a5c7-4b2c-90a5-c0f0e9b2358f None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:47.560762 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65aa0-a5c7-4b2c-90a5-c0f0e9b2358f None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:47.560762 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c65aa0-a5c7-4b2c-90a5-c0f0e9b2358f None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:47.562298 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 615/1223] 10.222.0.48 () {54 vars in 921 bytes} [Fri Aug 19 18:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:06:47.571449 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59245c-32e4-427c-9654-ebb2c55eca30 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:47.572067 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59245c-32e4-427c-9654-ebb2c55eca30 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:47.572067 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59245c-32e4-427c-9654-ebb2c55eca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:47.591937 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-9f59245c-32e4-427c-9654-ebb2c55eca30 None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:06:47.593180 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-9f59245c-32e4-427c-9654-ebb2c55eca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:06:47.601809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 609/1224] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Aug 19 18:06:47 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:06:47.622290 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65aa0-a5c7-4b2c-90a5-c0f0e9b2358f None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:06:47.636496 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c65aa0-a5c7-4b2c-90a5-c0f0e9b2358f None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:06:47.641886 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b220fe-c759-47d7-a37c-7bcaa2a078d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:06:47.648373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b220fe-c759-47d7-a37c-7bcaa2a078d4 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:06:47.648373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b220fe-c759-47d7-a37c-7bcaa2a078d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:06:47.648373 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b220fe-c759-47d7-a37c-7bcaa2a078d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:06:47.653595 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b220fe-c759-47d7-a37c-7bcaa2a078d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:06:47.656713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b220fe-c759-47d7-a37c-7bcaa2a078d4 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:06:47.671176 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 616/1225] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:06:47 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 18:06:57.586676 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=12 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:06:57.666575 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=15 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:07:06.116693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59245c-32e4-427c-9654-ebb2c55eca30 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:07:06.128788 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59245c-32e4-427c-9654-ebb2c55eca30 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:07:06.132855 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d95174-a6d5-4a98-bd60-f869300647a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:07:06.133508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95174-a6d5-4a98-bd60-f869300647a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:07:06.133789 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95174-a6d5-4a98-bd60-f869300647a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:07:06.134061 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95174-a6d5-4a98-bd60-f869300647a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:07:06.143534 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d95174-a6d5-4a98-bd60-f869300647a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:07:06.144966 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d95174-a6d5-4a98-bd60-f869300647a3 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:07:06.155194 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 610/1226] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:07:06 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:07:16.012638 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306211e-a403-4a2c-89c5-3887a72f5eea None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:07:16.013159 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306211e-a403-4a2c-89c5-3887a72f5eea None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:07:16.013303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306211e-a403-4a2c-89c5-3887a72f5eea None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:07:16.015333 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 617/1227] 10.222.0.48 () {54 vars in 921 bytes} [Fri Aug 19 18:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:07:16.038100 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17d05-195a-493e-bbb6-2f2de4e70a62 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:07:16.038667 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17d05-195a-493e-bbb6-2f2de4e70a62 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:07:16.038766 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17d05-195a-493e-bbb6-2f2de4e70a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:07:16.075293 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-87f17d05-195a-493e-bbb6-2f2de4e70a62 None None] MFA Rules not processed for user `cbf8fe29550b480dbb5294af4dc962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:07:16.076631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-87f17d05-195a-493e-bbb6-2f2de4e70a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:07:16.097890 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 611/1228] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Aug 19 18:07:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:07:16.112786 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306211e-a403-4a2c-89c5-3887a72f5eea None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:07:16.130343 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306211e-a403-4a2c-89c5-3887a72f5eea None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:07:16.136950 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a84d-22be-4145-8bda-6a678fb6e05b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:07:16.138539 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a84d-22be-4145-8bda-6a678fb6e05b service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:07:16.138831 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a84d-22be-4145-8bda-6a678fb6e05b service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:07:16.139133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a84d-22be-4145-8bda-6a678fb6e05b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:07:16.148746 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793a84d-22be-4145-8bda-6a678fb6e05b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:07:16.151501 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793a84d-22be-4145-8bda-6a678fb6e05b service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:07:16.164232 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 618/1229] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:07:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:07:26.055551 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=9 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:07:26.157965 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=6 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:08:17.607509 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920cbe-7299-45a0-95ae-c70889930840 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:08:17.608027 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920cbe-7299-45a0-95ae-c70889930840 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:08:17.608128 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43920cbe-7299-45a0-95ae-c70889930840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:08:17.636765 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-43920cbe-7299-45a0-95ae-c70889930840 None None] MFA Rules not processed for user `a2456362e27445dfa259b538cdd5b348`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:08:17.637996 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-43920cbe-7299-45a0-95ae-c70889930840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:08:17.662943 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 612/1230] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:08:17 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:08:27.660298 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=15 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:08:56.683575 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ed8f-db0e-4ca2-8d10-0acc02e687e5 None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:08:56.684102 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ed8f-db0e-4ca2-8d10-0acc02e687e5 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:08:56.684200 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654ed8f-db0e-4ca2-8d10-0acc02e687e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:08:56.702610 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-e654ed8f-db0e-4ca2-8d10-0acc02e687e5 None None] MFA Rules not processed for user `a2456362e27445dfa259b538cdd5b348`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:08:56.703803 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-e654ed8f-db0e-4ca2-8d10-0acc02e687e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:08:56.710608 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 619/1231] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:08:56 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:08:57.017502 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18db740-759b-4f58-83ad-1b9287927ffd None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:08:57.017969 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18db740-759b-4f58-83ad-1b9287927ffd None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:08:57.018054 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18db740-759b-4f58-83ad-1b9287927ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:08:57.075192 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-d18db740-759b-4f58-83ad-1b9287927ffd None None] MFA Rules not processed for user `b864fd056be54f2986135bbb77bdf7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:08:57.076376 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-d18db740-759b-4f58-83ad-1b9287927ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:08:57.107892 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 613/1232] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Aug 19 18:08:57 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:08:57.119027 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ed8f-db0e-4ca2-8d10-0acc02e687e5 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:08:57.129035 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654ed8f-db0e-4ca2-8d10-0acc02e687e5 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:08:57.132540 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a715cb4-a4d5-40b5-9c70-c351e3805082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:08:57.133133 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a715cb4-a4d5-40b5-9c70-c351e3805082 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:08:57.133466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a715cb4-a4d5-40b5-9c70-c351e3805082 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:08:57.133736 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a715cb4-a4d5-40b5-9c70-c351e3805082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:08:57.141205 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a715cb4-a4d5-40b5-9c70-c351e3805082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:08:57.142801 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a715cb4-a4d5-40b5-9c70-c351e3805082 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:08:57.150577 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 620/1233] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:08:57 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:09:07.104653 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=28 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:09:07.147056 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=9 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:09:16.697229 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc888-1028-4084-a300-fec2807b70f6 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:09:16.697724 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc888-1028-4084-a300-fec2807b70f6 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:09:16.697805 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abc888-1028-4084-a300-fec2807b70f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:09:16.718167 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-e6abc888-1028-4084-a300-fec2807b70f6 None None] MFA Rules not processed for user `a2456362e27445dfa259b538cdd5b348`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:09:16.719434 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-e6abc888-1028-4084-a300-fec2807b70f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:09:16.726237 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 614/1234] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:09:16 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:09:18.678648 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a715cb4-a4d5-40b5-9c70-c351e3805082 service neutron] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:09:18.709748 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a715cb4-a4d5-40b5-9c70-c351e3805082 service neutron] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:09:18.714673 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88183a6-7e89-4148-9613-38d141b803e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b03819209cf40619ba66506a8205b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:09:18.715268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88183a6-7e89-4148-9613-38d141b803e9 service placement] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:09:18.715545 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88183a6-7e89-4148-9613-38d141b803e9 service placement] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:09:18.715815 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88183a6-7e89-4148-9613-38d141b803e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:09:18.724329 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88183a6-7e89-4148-9613-38d141b803e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:09:18.725947 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88183a6-7e89-4148-9613-38d141b803e9 service placement] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:09:18.735459 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 621/1235] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:09:18 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:09:26.712863 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:09:28.731533 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=13 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:10:39.152849 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399cdc-adf5-4adb-90b2-0feb5c0cb76a None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:10:39.153353 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399cdc-adf5-4adb-90b2-0feb5c0cb76a None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:10:39.153479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a399cdc-adf5-4adb-90b2-0feb5c0cb76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:10:39.171863 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-5a399cdc-adf5-4adb-90b2-0feb5c0cb76a None None] MFA Rules not processed for user `a2456362e27445dfa259b538cdd5b348`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:10:39.174718 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-5a399cdc-adf5-4adb-90b2-0feb5c0cb76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:10:39.180016 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 615/1236] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:10:39 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:10:49.166638 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=3 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:10:53.137857 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88183a6-7e89-4148-9613-38d141b803e9 service placement] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:10:53.147081 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88183a6-7e89-4148-9613-38d141b803e9 service placement] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:10:53.150960 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa64e-7829-4e8b-a4c0-44871c5c05b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:10:53.152132 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa64e-7829-4e8b-a4c0-44871c5c05b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:10:53.152415 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa64e-7829-4e8b-a4c0-44871c5c05b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:10:53.152720 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6fa64e-7829-4e8b-a4c0-44871c5c05b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:10:53.162103 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fa64e-7829-4e8b-a4c0-44871c5c05b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:10:53.163719 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6fa64e-7829-4e8b-a4c0-44871c5c05b2 service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:10:53.173793 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 622/1237] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:10:53 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:11:03.169483 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=6 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:11:35.676189 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a399cdc-adf5-4adb-90b2-0feb5c0cb76a None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:11:35.701740 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a399cdc-adf5-4adb-90b2-0feb5c0cb76a None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:11:35.707309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f562-3e98-4e93-a964-67fbd08708f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:11:35.707906 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f562-3e98-4e93-a964-67fbd08708f3 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:11:35.708184 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f562-3e98-4e93-a964-67fbd08708f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:11:35.708455 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f562-3e98-4e93-a964-67fbd08708f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:11:35.716320 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281f562-3e98-4e93-a964-67fbd08708f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:11:35.717926 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281f562-3e98-4e93-a964-67fbd08708f3 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:11:35.727076 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 616/1238] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:11:35 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:11:35.779853 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa64e-7829-4e8b-a4c0-44871c5c05b2 service neutron] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:11:35.788555 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6fa64e-7829-4e8b-a4c0-44871c5c05b2 service neutron] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:11:35.792108 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c9654-b0ac-4c2a-a729-3a2d98fa8a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:11:35.792696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9654-b0ac-4c2a-a729-3a2d98fa8a2b service neutron] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:11:35.792997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9654-b0ac-4c2a-a729-3a2d98fa8a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:11:35.793271 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c9654-b0ac-4c2a-a729-3a2d98fa8a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:11:35.802885 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c9654-b0ac-4c2a-a729-3a2d98fa8a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:11:35.805175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c9654-b0ac-4c2a-a729-3a2d98fa8a2b service neutron] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:11:35.815078 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 623/1239] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:11:35 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:11:36.408535 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f562-3e98-4e93-a964-67fbd08708f3 service nova] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:11:36.418218 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f562-3e98-4e93-a964-67fbd08708f3 service nova] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:11:36.421900 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1b29e-0690-4551-9fea-f7e473c1e411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:11:36.423485 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1b29e-0690-4551-9fea-f7e473c1e411 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:11:36.423778 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1b29e-0690-4551-9fea-f7e473c1e411 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:11:36.424236 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1b29e-0690-4551-9fea-f7e473c1e411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:11:36.434164 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1b29e-0690-4551-9fea-f7e473c1e411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:11:36.438997 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1b29e-0690-4551-9fea-f7e473c1e411 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:11:36.445773 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 617/1240] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:11:36 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:11:37.860330 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c9654-b0ac-4c2a-a729-3a2d98fa8a2b service neutron] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:11:37.933344 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c9654-b0ac-4c2a-a729-3a2d98fa8a2b service neutron] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:11:37.937217 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f892c0-d53b-4f54-957e-98ccdc34357c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fb05df536de4b159101ffa5cc41c5ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:11:37.938590 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f892c0-d53b-4f54-957e-98ccdc34357c service cinder] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:11:37.940283 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f892c0-d53b-4f54-957e-98ccdc34357c service cinder] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:11:37.940283 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f892c0-d53b-4f54-957e-98ccdc34357c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:11:37.949789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f892c0-d53b-4f54-957e-98ccdc34357c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:11:37.951226 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f892c0-d53b-4f54-957e-98ccdc34357c service cinder] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:11:37.968703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 624/1241] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:11:37 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:11:46.441186 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=16 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:11:47.959672 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=36 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:11:51.503042 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1b29e-0690-4551-9fea-f7e473c1e411 service neutron] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:11:51.515695 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1b29e-0690-4551-9fea-f7e473c1e411 service neutron] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:11:51.520709 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633807d-9b6a-453d-a5be-6577cce5b9d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:11:51.521318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633807d-9b6a-453d-a5be-6577cce5b9d4 service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:11:51.522275 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633807d-9b6a-453d-a5be-6577cce5b9d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:11:51.522470 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633807d-9b6a-453d-a5be-6577cce5b9d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:11:51.531733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633807d-9b6a-453d-a5be-6577cce5b9d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:11:51.533652 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633807d-9b6a-453d-a5be-6577cce5b9d4 service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:11:51.544153 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 618/1242] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:11:51 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:12:01.539648 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=6 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:12:02.914840 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a646be2-e2f1-4196-8a57-2138adcc4fdd None None] REQUEST_METHOD: `POST` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:12:02.915375 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a646be2-e2f1-4196-8a57-2138adcc4fdd None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:12:02.915375 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a646be2-e2f1-4196-8a57-2138adcc4fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:12:02.935920 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.auth.core [None req-8a646be2-e2f1-4196-8a57-2138adcc4fdd None None] MFA Rules not processed for user `5c912ffef66a44a1a85108e26845edfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88352) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:12:02.935920 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-8a646be2-e2f1-4196-8a57-2138adcc4fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:12:02.942293 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 625/1243] 10.222.0.48 () {58 vars in 958 bytes} [Fri Aug 19 18:12:02 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:12:04.885159 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633807d-9b6a-453d-a5be-6577cce5b9d4 service nova] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:12:04.896852 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633807d-9b6a-453d-a5be-6577cce5b9d4 service nova] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:12:04.903576 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c0bb2-897f-4a73-8d9b-671fa55ca061 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b03819209cf40619ba66506a8205b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:12:04.905788 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c0bb2-897f-4a73-8d9b-671fa55ca061 service placement] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:12:04.905788 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c0bb2-897f-4a73-8d9b-671fa55ca061 service placement] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:12:04.905788 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c0bb2-897f-4a73-8d9b-671fa55ca061 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:12:04.913953 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c0bb2-897f-4a73-8d9b-671fa55ca061 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:12:04.915681 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c0bb2-897f-4a73-8d9b-671fa55ca061 service placement] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:12:04.928881 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 619/1244] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:12:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:12:12.928859 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=3 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:12:14.921610 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=6 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:12:25.351819 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a646be2-e2f1-4196-8a57-2138adcc4fdd None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:12:25.364247 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a646be2-e2f1-4196-8a57-2138adcc4fdd None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:12:25.371245 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3dafe-f8f0-477b-8411-919138dc3157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:12:25.371245 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3dafe-f8f0-477b-8411-919138dc3157 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:12:25.371245 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3dafe-f8f0-477b-8411-919138dc3157 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:12:25.371245 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3dafe-f8f0-477b-8411-919138dc3157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:12:25.379267 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3dafe-f8f0-477b-8411-919138dc3157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:12:25.380858 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3dafe-f8f0-477b-8411-919138dc3157 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:12:25.390538 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 626/1245] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:12:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:12:35.386843 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=6 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:12:37.225972 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c0bb2-897f-4a73-8d9b-671fa55ca061 service placement] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:12:37.235631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c0bb2-897f-4a73-8d9b-671fa55ca061 service placement] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:12:37.239393 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a3f83-5e7f-4c53-b1be-42f63c59dd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:12:37.240003 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a3f83-5e7f-4c53-b1be-42f63c59dd00 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:12:37.240280 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a3f83-5e7f-4c53-b1be-42f63c59dd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:12:37.240548 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a3f83-5e7f-4c53-b1be-42f63c59dd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:12:37.250669 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a3f83-5e7f-4c53-b1be-42f63c59dd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:12:37.252186 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a3f83-5e7f-4c53-b1be-42f63c59dd00 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:12:37.262310 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 620/1246] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:12:37 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 19 18:12:39.436769 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3dafe-f8f0-477b-8411-919138dc3157 service nova] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:12:39.447703 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3dafe-f8f0-477b-8411-919138dc3157 service nova] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:12:39.453562 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747255-d023-483e-bda5-b0a31fd54ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:12:39.454178 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747255-d023-483e-bda5-b0a31fd54ee1 service nova] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:12:39.454459 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747255-d023-483e-bda5-b0a31fd54ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:12:39.454732 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29747255-d023-483e-bda5-b0a31fd54ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:12:39.463776 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29747255-d023-483e-bda5-b0a31fd54ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:12:39.466327 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29747255-d023-483e-bda5-b0a31fd54ee1 service nova] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:12:39.477279 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 627/1247] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:12:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:12:47.257478 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=6 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:12:49.472805 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=6 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:14:20.137522 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a3f83-5e7f-4c53-b1be-42f63c59dd00 service neutron] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:14:20.148725 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a3f83-5e7f-4c53-b1be-42f63c59dd00 service neutron] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:14:20.153693 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97ca5-c1f9-4bf6-8059-bdd2faf6ffbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbf8fe29550b480dbb5294af4dc962c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:14:20.154290 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97ca5-c1f9-4bf6-8059-bdd2faf6ffbb service nova] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:20.154565 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97ca5-c1f9-4bf6-8059-bdd2faf6ffbb service nova] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:20.154834 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e97ca5-c1f9-4bf6-8059-bdd2faf6ffbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:20.163174 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97ca5-c1f9-4bf6-8059-bdd2faf6ffbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:14:20.164752 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e97ca5-c1f9-4bf6-8059-bdd2faf6ffbb service nova] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:14:20.173282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 621/1248] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:14:20 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:14:25.467780 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747255-d023-483e-bda5-b0a31fd54ee1 service nova] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:14:25.479209 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29747255-d023-483e-bda5-b0a31fd54ee1 service nova] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:14:25.484268 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f52f2-9c2c-434c-8af4-b8ba88719f0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b03819209cf40619ba66506a8205b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:14:25.491686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f52f2-9c2c-434c-8af4-b8ba88719f0c service placement] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:25.491686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f52f2-9c2c-434c-8af4-b8ba88719f0c service placement] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:25.491686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f52f2-9c2c-434c-8af4-b8ba88719f0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:25.491686 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-d82f52f2-9c2c-434c-8af4-b8ba88719f0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:14:25.513125 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f52f2-9c2c-434c-8af4-b8ba88719f0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:14:25.514777 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f52f2-9c2c-434c-8af4-b8ba88719f0c service placement] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:14:25.525874 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 628/1249] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:14:25 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:14:30.169384 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=6 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:14:33.229896 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97ca5-c1f9-4bf6-8059-bdd2faf6ffbb service nova] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:14:33.239223 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e97ca5-c1f9-4bf6-8059-bdd2faf6ffbb service nova] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:14:33.243609 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049efc2-8e38-425e-8ac7-6e0504868766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:14:33.244549 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049efc2-8e38-425e-8ac7-6e0504868766 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:33.245190 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049efc2-8e38-425e-8ac7-6e0504868766 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:33.245679 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049efc2-8e38-425e-8ac7-6e0504868766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:33.323529 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049efc2-8e38-425e-8ac7-6e0504868766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:14:33.325044 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049efc2-8e38-425e-8ac7-6e0504868766 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:14:33.343548 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 622/1250] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:14:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:14:35.521184 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=11 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:14:36.996429 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa051e2-513c-4397-9763-38fc17c3d8d1 None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:36.997308 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa051e2-513c-4397-9763-38fc17c3d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:37.004499 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa051e2-513c-4397-9763-38fc17c3d8d1 None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:37.008508 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 629/1251] 10.222.0.48 () {54 vars in 921 bytes} [Fri Aug 19 18:14:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:14:37.029639 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973c53a-7c79-4368-b156-8008b8f66bc6 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:37.030176 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973c53a-7c79-4368-b156-8008b8f66bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:37.030271 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973c53a-7c79-4368-b156-8008b8f66bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:37.069706 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-6973c53a-7c79-4368-b156-8008b8f66bc6 None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:14:37.070840 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-6973c53a-7c79-4368-b156-8008b8f66bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:14:37.079458 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 623/1252] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Aug 19 18:14:37 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 19 18:14:37.090466 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa051e2-513c-4397-9763-38fc17c3d8d1 None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:14:37.092413 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-2aa051e2-513c-4397-9763-38fc17c3d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:14:37.109007 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa051e2-513c-4397-9763-38fc17c3d8d1 None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:14:37.114798 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9006-9234-4318-9b7a-03965e8baf56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b03819209cf40619ba66506a8205b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:14:37.115436 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9006-9234-4318-9b7a-03965e8baf56 service placement] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:37.115714 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9006-9234-4318-9b7a-03965e8baf56 service placement] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:37.115989 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc9006-9234-4318-9b7a-03965e8baf56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:37.125505 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc9006-9234-4318-9b7a-03965e8baf56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:14:37.127401 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc9006-9234-4318-9b7a-03965e8baf56 service placement] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:14:37.154298 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 630/1253] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:14:37 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:14:40.573690 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973c53a-7c79-4368-b156-8008b8f66bc6 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:14:40.586375 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973c53a-7c79-4368-b156-8008b8f66bc6 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:14:40.590784 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:14:40.591412 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:40.591687 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:40.591958 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] PATH_INFO: `/v3/users/a2456362e27445dfa259b538cdd5b348` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:40.593174 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2456362e27445dfa259b538cdd5b348)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:14:40.594273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: WARNING py.warnings [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:14:40.594273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: warnings.warn(msg) Aug 19 18:14:40.594273 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: Aug 19 18:14:40.595999 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:14:40.833353 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2456362e27445dfa259b538cdd5b348'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:40.852482 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2456362e27445dfa259b538cdd5b348'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:40.853186 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2456362e27445dfa259b538cdd5b348'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:40.863479 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2456362e27445dfa259b538cdd5b348'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:40.947879 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2456362e27445dfa259b538cdd5b348'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:40.954318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 624/1254] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Aug 19 18:14:40 2022] DELETE /identity/v3/users/a2456362e27445dfa259b538cdd5b348 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:14:41.235110 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9006-9234-4318-9b7a-03965e8baf56 service placement] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:14:41.246262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc9006-9234-4318-9b7a-03965e8baf56 service placement] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:14:41.303020 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:14:41.303647 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:41.303920 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:41.304187 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] PATH_INFO: `/v3/projects/f751d059104b4c54a9a38df15a1ad235` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:41.305272 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f751d059104b4c54a9a38df15a1ad235)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:14:41.306902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: WARNING py.warnings [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 19 18:14:41.306902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: warnings.warn(msg) Aug 19 18:14:41.306902 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: Aug 19 18:14:41.308082 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:14:41.405834 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f751d059104b4c54a9a38df15a1ad235', 'request_id': 'req-2c9ee515-1981-41d0-9081-e133c12b09a7'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.411698 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f751d059104b4c54a9a38df15a1ad235', 'request_id': 'req-2c9ee515-1981-41d0-9081-e133c12b09a7'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.424696 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f751d059104b4c54a9a38df15a1ad235', 'request_id': 'req-2c9ee515-1981-41d0-9081-e133c12b09a7'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.526813 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] The token cache is being invalidate because project f751d059104b4c54a9a38df15a1ad235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 18:14:41.527109 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.527733 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.529358 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 631/1255] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Aug 19 18:14:41 2022] DELETE /identity/v3/projects/f751d059104b4c54a9a38df15a1ad235 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:14:41.533596 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:14:41.535212 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:14:41.549461 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd0f4d-e62e-4c68-b681-aed0ae98c6cf admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:14:41.575489 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:14:41.605955 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:14:41.606641 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:41.606939 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:41.607209 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] PATH_INFO: `/v3/users/d2c2a5b9bec544ea87bc9232ecef01ea` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:41.608315 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c2a5b9bec544ea87bc9232ecef01ea)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:14:41.610388 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:14:41.801593 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c2a5b9bec544ea87bc9232ecef01ea'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.813507 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c2a5b9bec544ea87bc9232ecef01ea'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.814205 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c2a5b9bec544ea87bc9232ecef01ea'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.822114 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c2a5b9bec544ea87bc9232ecef01ea'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.890483 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c2a5b9bec544ea87bc9232ecef01ea'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:41.897032 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 625/1256] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Aug 19 18:14:41 2022] DELETE /identity/v3/users/d2c2a5b9bec544ea87bc9232ecef01ea => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:14:42.155820 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:14:42.157276 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:14:42.172456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ee515-1981-41d0-9081-e133c12b09a7 admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:14:42.229439 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:14:42.230096 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:14:42.230370 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:14:42.230637 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] PATH_INFO: `/v3/projects/f449efb7a0b043a99ceef58858fe9ace` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:14:42.231733 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f449efb7a0b043a99ceef58858fe9ace)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:14:42.233658 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:14:42.242414 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:14:42.348666 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f449efb7a0b043a99ceef58858fe9ace', 'request_id': 'req-688a6601-40e4-476a-989f-650842dda6d0'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:42.354262 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f449efb7a0b043a99ceef58858fe9ace', 'request_id': 'req-688a6601-40e4-476a-989f-650842dda6d0'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:42.360415 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f449efb7a0b043a99ceef58858fe9ace', 'request_id': 'req-688a6601-40e4-476a-989f-650842dda6d0'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:42.438208 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] The token cache is being invalidate because project f449efb7a0b043a99ceef58858fe9ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 18:14:42.438429 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:42.439069 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-688a6601-40e4-476a-989f-650842dda6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:14:42.440758 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 632/1257] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Aug 19 18:14:42 2022] DELETE /identity/v3/projects/f449efb7a0b043a99ceef58858fe9ace => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:14:51.893226 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:14:52.451431 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:15:11.034733 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:15:11.036189 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:15:11.105150 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68836f86-648f-41e5-8450-2cea56c236d8 admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:15:11.152615 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7758ac-55ac-40ef-bb2b-a76d45362071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b864fd056be54f2986135bbb77bdf7d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:15:11.153222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7758ac-55ac-40ef-bb2b-a76d45362071 service neutron] REQUEST_METHOD: `GET` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:15:11.153533 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7758ac-55ac-40ef-bb2b-a76d45362071 service neutron] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:15:11.153809 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7758ac-55ac-40ef-bb2b-a76d45362071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:15:11.155542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-2a7758ac-55ac-40ef-bb2b-a76d45362071 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:15:11.217214 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7758ac-55ac-40ef-bb2b-a76d45362071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:15:11.218682 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7758ac-55ac-40ef-bb2b-a76d45362071 service neutron] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:15:11.228222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 626/1258] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:15:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:15:14.965506 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09626-17a6-4b8c-a22b-c7d4ba1b425c None None] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:15:14.966175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09626-17a6-4b8c-a22b-c7d4ba1b425c None None] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:15:14.966175 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a09626-17a6-4b8c-a22b-c7d4ba1b425c None None] PATH_INFO: `/` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:15:14.967456 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 633/1259] 10.222.0.48 () {54 vars in 921 bytes} [Fri Aug 19 18:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 19 18:15:14.997846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf776d-669a-48cf-8a13-e01282439170 None None] REQUEST_METHOD: `POST` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:15:14.998336 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf776d-669a-48cf-8a13-e01282439170 None None] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:15:14.998539 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf776d-669a-48cf-8a13-e01282439170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:15:15.018905 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.auth.core [None req-67cf776d-669a-48cf-8a13-e01282439170 None None] MFA Rules not processed for user `1b03819209cf40619ba66506a8205b68`. Rule list: `[]` (Enabled: `True`). {{(pid=88351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 19 18:15:15.023508 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-67cf776d-669a-48cf-8a13-e01282439170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:15:15.068093 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=100 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:15:15.086873 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 627/1260] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Aug 19 18:15:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 19 18:15:15.115770 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09626-17a6-4b8c-a22b-c7d4ba1b425c None None] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:15:15.117811 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-a9a09626-17a6-4b8c-a22b-c7d4ba1b425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:15:15.137401 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a09626-17a6-4b8c-a22b-c7d4ba1b425c None None] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:15:15.141531 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743288b-b71a-47b6-9682-d407744fa5e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b03819209cf40619ba66506a8205b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0faa0bfd1ad0406eb336f391d6846bbd', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:15:15.142150 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743288b-b71a-47b6-9682-d407744fa5e0 service placement] REQUEST_METHOD: `GET` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:15:15.142434 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743288b-b71a-47b6-9682-d407744fa5e0 service placement] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:15:15.142713 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743288b-b71a-47b6-9682-d407744fa5e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:15:15.152759 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743288b-b71a-47b6-9682-d407744fa5e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:15:15.154418 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743288b-b71a-47b6-9682-d407744fa5e0 service placement] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:15:15.164489 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 634/1261] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Aug 19 18:15:15 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 19 18:15:18.366512 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf776d-669a-48cf-8a13-e01282439170 None None] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:15:18.368110 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-67cf776d-669a-48cf-8a13-e01282439170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:15:18.381800 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf776d-669a-48cf-8a13-e01282439170 None None] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:15:18.388970 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:15:18.389846 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:15:18.390130 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:15:18.390404 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] PATH_INFO: `/v3/users/5c912ffef66a44a1a85108e26845edfc` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:15:18.391542 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c912ffef66a44a1a85108e26845edfc)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:15:18.393503 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:15:18.573152 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c912ffef66a44a1a85108e26845edfc'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:18.585624 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c912ffef66a44a1a85108e26845edfc'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:18.586342 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c912ffef66a44a1a85108e26845edfc'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:18.592987 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c912ffef66a44a1a85108e26845edfc'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:18.667292 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c912ffef66a44a1a85108e26845edfc'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:18.673391 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 628/1262] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Aug 19 18:15:18 2022] DELETE /identity/v3/users/5c912ffef66a44a1a85108e26845edfc => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:15:18.898444 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743288b-b71a-47b6-9682-d407744fa5e0 service placement] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:15:18.911995 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743288b-b71a-47b6-9682-d407744fa5e0 service placement] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:15:18.966677 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:15:18.967303 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:15:18.967582 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:15:18.967854 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] PATH_INFO: `/v3/projects/341e7537e4c84625be31484e1d6bcd3b` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:15:18.968957 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=341e7537e4c84625be31484e1d6bcd3b)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:15:18.970908 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:15:19.078352 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341e7537e4c84625be31484e1d6bcd3b', 'request_id': 'req-85758d1d-649a-4a83-a97b-085123925e3e'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.083794 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341e7537e4c84625be31484e1d6bcd3b', 'request_id': 'req-85758d1d-649a-4a83-a97b-085123925e3e'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.091715 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341e7537e4c84625be31484e1d6bcd3b', 'request_id': 'req-85758d1d-649a-4a83-a97b-085123925e3e'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.152166 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] The token cache is being invalidate because project 341e7537e4c84625be31484e1d6bcd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 18:15:19.152450 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.153066 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.154555 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 635/1263] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Aug 19 18:15:18 2022] DELETE /identity/v3/projects/341e7537e4c84625be31484e1d6bcd3b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 19 18:15:19.158631 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] Authenticating user token {{(pid=88351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:15:19.160047 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.fernet_utils [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:15:19.173276 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd296dae-8bf5-40f2-a9f4-f2d1085551af admin admin] Validating token access rules against request {{(pid=88351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:15:19.228986 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:15:19.229654 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:15:19.229932 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:15:19.230204 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] PATH_INFO: `/v3/users/6dcf2ad2aeeb493e9d5bc839edf9bcdb` {{(pid=88351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:15:19.231318 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcf2ad2aeeb493e9d5bc839edf9bcdb)` {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:15:19.233238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] RBAC: Authorization granted {{(pid=88351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:15:19.395309 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcf2ad2aeeb493e9d5bc839edf9bcdb'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.407282 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcf2ad2aeeb493e9d5bc839edf9bcdb'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.407984 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcf2ad2aeeb493e9d5bc839edf9bcdb'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.409170 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:15:19.416238 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcf2ad2aeeb493e9d5bc839edf9bcdb'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.472854 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG keystone.notifications [None req-afbbb4b9-deb1-4975-a24a-0efc49a9acdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcf2ad2aeeb493e9d5bc839edf9bcdb'} {{(pid=88351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.479452 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: [pid: 88351|app: 0|req: 629/1264] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Aug 19 18:15:19 2022] DELETE /identity/v3/users/6dcf2ad2aeeb493e9d5bc839edf9bcdb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:15:19.702997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] Authenticating user token {{(pid=88352) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 19 18:15:19.704564 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.fernet_utils [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88352) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 19 18:15:19.718368 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85758d1d-649a-4a83-a97b-085123925e3e admin admin] Validating token access rules against request {{(pid=88352) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 19 18:15:19.777054 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd3642203b2a4a53b69987de767c8bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36dbac3e54734453afe30db9d0d35548', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88352) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 19 18:15:19.777721 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 19 18:15:19.777997 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 19 18:15:19.778266 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] PATH_INFO: `/v3/projects/6eb94c59b5864ef8adfd8b2ea84c6281` {{(pid=88352) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 19 18:15:19.779358 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb94c59b5864ef8adfd8b2ea84c6281)` {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 19 18:15:19.781266 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] RBAC: Authorization granted {{(pid=88352) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 19 18:15:19.801615 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:15:19.936155 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb94c59b5864ef8adfd8b2ea84c6281', 'request_id': 'req-b19fe70b-b353-478a-99e5-e9525bf45982'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.941789 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb94c59b5864ef8adfd8b2ea84c6281', 'request_id': 'req-b19fe70b-b353-478a-99e5-e9525bf45982'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:19.948712 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb94c59b5864ef8adfd8b2ea84c6281', 'request_id': 'req-b19fe70b-b353-478a-99e5-e9525bf45982'} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:20.175116 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] The token cache is being invalidate because project 6eb94c59b5864ef8adfd8b2ea84c6281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88352) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 19 18:15:20.175416 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:20.176002 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG keystone.notifications [None req-b19fe70b-b353-478a-99e5-e9525bf45982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88352) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 19 18:15:20.178094 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: [pid: 88352|app: 0|req: 636/1265] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Aug 19 18:15:19 2022] DELETE /identity/v3/projects/6eb94c59b5864ef8adfd8b2ea84c6281 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 19 18:15:29.547222 dv-osbrick-853778-2-ceph devstack@keystone.service[88351]: DEBUG dbcounter [-] [88351] Writing DB stats keystone:SELECT=6,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 19 18:15:30.171896 dv-osbrick-853778-2-ceph devstack@keystone.service[88352]: DEBUG dbcounter [-] [88352] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88352) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}